-- Logs begin at Thu 2022-07-14 12:10:37 UTC, end at Thu 2022-07-14 13:23:05 UTC. -- Jul 14 12:48:25.047697 dv-osbrick-849759-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Jul 14 12:48:25.056579 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 14 12:48:25.059247 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 12:48:25 2022] *** Jul 14 12:48:25.059386 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 12:48:25.059504 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 12:48:25.059611 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: nodename: dv-osbrick-849759-4-ceph Jul 14 12:48:25.059715 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: machine: x86_64 Jul 14 12:48:25.059824 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: clock source: unix Jul 14 12:48:25.059928 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: pcre jit disabled Jul 14 12:48:25.060048 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: detected number of CPU cores: 4 Jul 14 12:48:25.060048 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: current working directory: / Jul 14 12:48:25.060048 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: detected binary path: /usr/bin/uwsgi-core Jul 14 12:48:25.060048 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: your processes number limit is 47680 Jul 14 12:48:25.060048 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: your memory page size is 4096 bytes Jul 14 12:48:25.060048 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: detected max file descriptor number: 2048 Jul 14 12:48:25.060048 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: lock engine: pthread robust mutexes Jul 14 12:48:25.060535 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: thunder lock: enabled Jul 14 12:48:25.060535 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 14 12:48:25.060535 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 14 12:48:25.110942 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: Python main interpreter initialized at 0x563a35ff49c0 Jul 14 12:48:25.110942 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: python threads support enabled Jul 14 12:48:25.110942 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: your server socket listen backlog is limited to 100 connections Jul 14 12:48:25.110942 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: your mercy for graceful operations on workers is 90 seconds Jul 14 12:48:25.111311 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 12:48:25.111386 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: *** Operational MODE: preforking *** Jul 14 12:48:25.111636 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: *** uWSGI is running in multiple interpreter mode *** Jul 14 12:48:25.111636 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: spawned uWSGI master process (pid: 87231) Jul 14 12:48:25.111847 dv-osbrick-849759-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Jul 14 12:48:25.116672 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: spawned uWSGI worker 1 (pid: 87244, cores: 1) Jul 14 12:48:25.116672 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: spawned uWSGI worker 2 (pid: 87245, cores: 1) Jul 14 12:48:25.116672 dv-osbrick-849759-4-ceph devstack@keystone.service[87231]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 12:48:30.898808 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 12:48:30.898808 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: from cryptography.utils import int_from_bytes Jul 14 12:48:30.899651 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 12:48:30.899651 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: from cryptography.utils import int_from_bytes Jul 14 12:48:30.899815 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 12:48:30.899815 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: from cryptography.utils import int_from_bytes Jul 14 12:48:30.900332 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 12:48:30.900332 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: from cryptography.utils import int_from_bytes Jul 14 12:48:30.948171 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 12:48:30.948453 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 12:48:30.948676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] command line args: [] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 12:48:30.948956 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 12:48:30.949136 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ================================================================================ {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 12:48:30.949394 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] admin_token = **** {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.949481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 12:48:30.949643 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] config_dir = [] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.949723 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 12:48:30.949832 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.949917 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] command line args: [] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 12:48:30.950016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] config_source = [] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.950130 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 12:48:30.950214 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] debug = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.950293 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ================================================================================ {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 12:48:30.950379 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.950639 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] admin_token = **** {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.950761 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.950849 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] config_dir = [] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.950916 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.950974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.951131 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] config_source = [] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.951209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.951314 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] debug = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.951399 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.951503 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.951641 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] list_limit = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.951741 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.951823 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] log_config_append = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.952003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.952077 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.952193 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] log_dir = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.952272 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.952372 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] log_file = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.952454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.952734 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.952842 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] list_limit = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.952842 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] log_config_append = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.953121 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.953188 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.953258 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.953322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] log_dir = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.953385 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] log_file = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.953442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.953543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.953663 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.953758 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.953838 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.953961 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.954069 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.954212 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.954308 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.954441 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.954527 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.954622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.954702 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.954869 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.955047 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.955122 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.955188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.955340 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.955449 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.955586 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.955686 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.955819 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.955903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.956052 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.956302 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.956430 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.956583 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] publish_errors = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.956681 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.956766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.956845 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.956986 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.957167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.957336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.957504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.957925 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] publish_errors = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.958061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.958199 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.958334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] standard_threads = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.958453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.958578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.958656 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.958732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.958809 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.958886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.958988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.959067 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] use_journal = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.959139 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] standard_threads = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.959208 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] use_json = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.959278 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] use_stderr = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.959352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.959499 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] use_syslog = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.959580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.959658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.959729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.959803 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] use_journal = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.959873 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.959998 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] use_json = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.960085 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.960164 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] use_stderr = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.960290 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] use_syslog = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.960368 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.960525 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 12:48:30.960622 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.960808 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.960898 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.961049 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.961137 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.961309 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.961399 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.961547 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.961631 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.961796 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.961874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.962032 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.962122 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.962280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.962358 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.962515 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.962593 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.962759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.962849 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.962997 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.963075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.963240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.963323 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.963476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.963567 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.963716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.963801 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.963952 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.964030 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.964199 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.964289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.964447 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.964527 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.964706 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.964801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.964948 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.965028 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.965206 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.965284 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.965453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.965521 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.965691 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.965788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.965925 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.966010 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.966162 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.966240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.966398 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.966480 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.966638 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.966722 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.966890 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.966970 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.967123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.967209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.967357 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.967443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.968107 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.968189 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.968362 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.968442 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.968612 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.968758 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.968870 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.968999 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.969109 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.969190 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.969348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.969436 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.969589 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.969682 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.969824 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.969904 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.970056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.970134 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.970291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.970376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.970525 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.970612 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.970758 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.970845 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.970988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.971067 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.971222 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.971303 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.971454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.971541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.971686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.971764 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.971918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.972007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.972157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.972237 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.972388 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.972471 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.972625 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.972832 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.972917 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.972988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.973112 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.973199 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.973346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.973434 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.973583 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.973662 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.973811 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.973895 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.974047 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.974134 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.974280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.974358 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.974518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.974598 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.974753 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.974839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.974987 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.975064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.975217 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.975308 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.975464 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.975553 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.975702 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.975787 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.975935 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.976014 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.976164 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.976251 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.976399 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.976479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.976663 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.976744 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.976903 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.977058 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.977225 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.977353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.977430 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.977502 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.977617 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.977706 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.977855 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.978002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.978127 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.978203 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.978331 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.978423 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.978570 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.978660 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.978807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.978886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.979045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.979126 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.979290 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.979377 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.979527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.979606 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.979764 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.979843 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.980004 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.980091 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.980242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.980322 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.980481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.980562 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.980756 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.980839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.980993 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.981072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.981230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.981326 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.981472 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.981552 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.981713 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.981794 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.981951 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.982032 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.982188 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.982270 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.982420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.982504 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.982656 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.982734 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.982889 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.982975 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.983122 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.983237 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.983924 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.984016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.984147 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.984226 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.984383 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.984462 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.984620 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.984817 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.984946 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.985025 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.985097 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.985168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.985332 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.985411 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.985582 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.985664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.985820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.985900 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] auth.external = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.986054 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.986131 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.986325 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.986405 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.986568 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.986658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.986803 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] auth.password = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.986908 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] auth.external = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.987033 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.987114 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] auth.token = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.987271 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.987351 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.987511 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.987590 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.987762 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.987841 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] auth.password = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.987991 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] auth.token = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.988071 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.988232 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.988311 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.988470 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.988549 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.988726 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.988809 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.988963 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.989065 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] credential.caching = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.989210 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.989292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.989458 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.989541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.989690 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.989770 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.989926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] credential.caching = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.990007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.990170 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.990256 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.990409 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.990490 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.990661 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.990740 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.990899 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.990981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.991144 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.991224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.991382 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.991506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.991688 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.991769 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.991887 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.991969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.992125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.992206 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.992377 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.992459 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.992680 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.992765 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.992902 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] federation.caching = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.992983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.993144 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.993227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.993395 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.993481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.993646 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.993735 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.993882 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] federation.caching = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.993961 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.994122 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.994202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.994360 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.994450 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.994605 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.994684 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.994838 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.994924 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.995085 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.995175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.995322 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.995401 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.995579 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.995705 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.995807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.995896 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] identity.caching = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.996055 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.996135 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.996289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.996368 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.996532 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.996624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.996791 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] identity.caching = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.996871 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.997041 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.997122 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.997292 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.997386 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.997531 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.997613 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.997769 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.997849 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.998018 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.998106 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.998250 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.998337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.998483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.998563 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.998719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.998809 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.998995 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.999076 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.999230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.999312 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.999463 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.999551 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.999695 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.999773 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:30.999943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.000033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.000189 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.000279 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.000442 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.000528 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.000711 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.000795 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.000950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.001043 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.001191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.001272 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.001426 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.001507 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.001669 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.001757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.001898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.001978 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.002136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.002222 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.002367 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.002459 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.002604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.002685 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.002844 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.002924 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.003083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.003165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.003318 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.003396 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.003549 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.003628 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.003797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.003880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.004027 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.004108 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.004266 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.004345 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.004500 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.004581 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.004767 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.004849 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.004999 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.005077 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.005236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.005325 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.005467 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.005549 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.005706 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.005784 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.005941 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.006029 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.006180 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.006260 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.006416 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.006495 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.006649 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.006738 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.006897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.006978 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.007145 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.007223 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.007373 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.007454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.007604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.007684 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.007840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.007919 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.008076 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.008158 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.008310 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.008389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.008546 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.008628 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.008813 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.008898 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.009046 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.009127 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.009286 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.009366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.009540 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.009621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.009772 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.009850 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.010002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.010081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.010241 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.010324 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.010481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.010561 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.010718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.010798 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.010948 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.011029 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.011186 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.011265 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.011422 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.011502 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.011660 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.011748 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.011892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.011973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.012138 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.012216 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.012372 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.012460 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.012616 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.012748 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.012879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.012958 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.013119 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.013202 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.013348 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.013433 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.013582 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.013662 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.013823 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.013904 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.014061 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.014142 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.014298 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.014376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.014558 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.014638 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.014790 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.014877 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.015036 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.015114 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.015271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.015351 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.015505 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.015584 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.015742 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.015822 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.015986 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.016069 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.016223 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.016303 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.016453 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.016532 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.016716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.016801 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.016963 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] resource.caching = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.017043 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.017205 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.017285 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.017440 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.017523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.017676 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.017756 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.017916 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] resource.caching = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.017995 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.018165 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.018247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.018401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.018479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.018634 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.018721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.018878 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.018947 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.019123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.019201 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.019358 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.019450 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] role.caching = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.019603 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.019684 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] role.driver = sql {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.019834 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.019912 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.020070 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.020157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.020311 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] role.caching = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.020391 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.020556 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] role.driver = sql {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.020687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.020810 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.020903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.021059 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.021139 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.021305 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.021384 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.021553 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.021640 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.021800 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.021879 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.022037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.022125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.022282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.022369 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.022530 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.022612 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.022777 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.022856 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.023011 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.023099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.023257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.023415 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.023494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.023654 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.023734 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.023907 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.023989 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.024158 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.024354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.024433 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.024591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.024697 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.024867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.024948 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.025118 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.025204 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.025366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.025448 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.025613 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.025693 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.025845 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.025924 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.026079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.026160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.026313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.026393 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.026564 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.026642 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.026799 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.026881 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.027033 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.027112 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.027264 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.027344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.027510 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.027591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.027745 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.027825 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.027984 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] token.caching = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.028063 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.028219 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.028299 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.028457 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.028537 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.028717 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.028826 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.028956 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] token.caching = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.029094 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.029196 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.029345 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.029447 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.029586 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.029675 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.029835 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.029924 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.030603 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.030698 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.030853 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.030944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.031094 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.031175 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.031335 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.031415 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.031576 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.031665 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.031819 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.031899 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.032057 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.032138 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.032292 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.032381 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.032537 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.032616 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.032809 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.032893 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.033042 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.033131 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.connection = **** {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.033284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.033374 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.033575 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.033662 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.033817 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.033906 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.connection = **** {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.034059 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.034151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.034301 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.034378 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.034521 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.034602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.034760 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.034839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.035002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.035116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.035231 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.035312 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.035466 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.035546 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.035701 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.035782 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.035934 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.036011 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.036185 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.036264 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.036423 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.036503 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.036679 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.036761 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.036916 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.036990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.037158 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.037245 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.037391 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.037468 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.037561 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87244) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 12:48:31.037640 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.037845 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.038079 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 12:48:31.038248 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87245) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 12:48:31.068475 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.068714 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.068823 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.068901 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.068964 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.069120 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.077946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.078062 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.106090 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.106288 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.106385 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.106525 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.159555 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.159749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.210546 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.210772 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.210925 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.211167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.275395 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.275619 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.275843 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.275929 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.276063 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.276150 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.276283 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.276376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.276500 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.276592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.276744 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.276979 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.299989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.300231 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.300447 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.300557 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.300700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.300787 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.300945 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.301053 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.301146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.301223 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.301342 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.301425 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.301551 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.301761 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.314287 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.314461 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.326847 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.327525 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.327614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.327761 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.327847 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.327985 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.328069 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.328202 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.328296 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.328414 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.328496 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.328620 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.328730 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87244) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.328858 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87245) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 14 12:48:31.346433 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.346644 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 12:48:31.346880 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.346978 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.347053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 12:48:31.347171 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 12:48:31.347337 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.347447 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.347531 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 14 12:48:31.347707 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.347800 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.347965 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.348046 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.348219 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.348300 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.348499 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.359775 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.360047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.360134 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.360313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.360395 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.360576 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.360688 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.360888 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.368728 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.368960 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87245) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.372005 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.372215 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87245) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.372301 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.372490 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.372573 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.372790 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.372912 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.373094 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.373216 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.373470 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.373659 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.373745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.373849 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.374529 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.374706 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.374788 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.374989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.375072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.375265 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.375346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.375534 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.375615 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.401976 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.402105 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.403589 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.403715 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87245) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.403865 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.404003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.409171 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.409382 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87245) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.409481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.409698 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.409799 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.409938 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.417060 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.417269 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87245) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.417383 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.417546 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.422517 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.422653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87245) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.422803 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.422935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.423085 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.423220 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.423364 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.423500 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.423634 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.423771 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.423907 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.424044 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.424177 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.424308 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.424442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.424570 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.443714 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.443868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.443992 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.444080 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.448510 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87245) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.448670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.452194 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.452392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.452477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.452744 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.457496 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87245) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.458025 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.461350 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87245) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.461723 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.465088 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.465382 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.465507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.465663 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.465807 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.465946 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.466090 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.466253 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.466370 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.466539 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.466660 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.466943 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.486502 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87245) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.486778 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.486971 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.487132 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.487259 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.487392 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.487620 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.487882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.495302 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.495848 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.497057 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.497331 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.497599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.497872 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.500409 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87245) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.500708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.500975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.501060 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.501255 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.501338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.511516 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.511605 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.511605 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.511605 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.514903 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87245) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.515178 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.515511 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.515602 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.515732 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.515847 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.516006 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.516093 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.516273 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.516359 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.516542 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.516657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.516865 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.517140 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.535090 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87245) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.535751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.538364 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87245) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.539022 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.541692 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.542373 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.543297 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.543990 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.544961 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87245) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.545238 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.545515 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.545644 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.546497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.546780 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.553465 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.554220 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.555077 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87245) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.555829 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.558356 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.558637 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.558914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.559086 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.559185 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.559374 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.559657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.559931 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.569432 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87245) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.569715 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.569990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.570260 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.570542 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.570817 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.577993 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87245) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.578269 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.578552 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.578787 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87244) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 14 12:48:31.578896 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.579055 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.579140 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.579335 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.579423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.579610 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.579693 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.579873 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.579963 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.580139 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.580222 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.580411 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.580492 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.580700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.580800 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.580960 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.581041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.581220 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.581302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.581476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87245) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.581562 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.581764 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.582026 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.582285 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87244) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 14 12:48:31.619700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563a35ff49c0 pid: 87245 (default app) Jul 14 12:48:31.620761 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563a35ff49c0 pid: 87244 (default app) Jul 14 12:48:31.623062 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce4dba-c3d2-4660-a93e-ae678012fde6 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:31.623351 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce4dba-c3d2-4660-a93e-ae678012fde6 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:31.623629 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce4dba-c3d2-4660-a93e-ae678012fde6 None None] PATH_INFO: `/v3` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:31.628337 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Thu Jul 14 12:48:31 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:48:40.871014 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ac75f-f79b-4f7c-b0e0-e30262621056 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:40.871529 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ac75f-f79b-4f7c-b0e0-e30262621056 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:40.871616 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624ac75f-f79b-4f7c-b0e0-e30262621056 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:40.876052 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:48:40 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:48:40.881535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd3a48-a142-4c04-9337-7c6b285e54e6 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:40.881948 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd3a48-a142-4c04-9337-7c6b285e54e6 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:40.882100 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebd3a48-a142-4c04-9337-7c6b285e54e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:40.955555 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: INFO dbcounter [None req-bebd3a48-a142-4c04-9337-7c6b285e54e6 None None] Registered counter for database keystone Jul 14 12:48:40.977247 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG oslo_db.sqlalchemy.engines [None req-bebd3a48-a142-4c04-9337-7c6b285e54e6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87245) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 12:48:40.983585 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writer thread running {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 12:48:41.165317 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG passlib.handlers.bcrypt [None req-bebd3a48-a142-4c04-9337-7c6b285e54e6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87245) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 12:48:41.165735 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG passlib.handlers.bcrypt [None req-bebd3a48-a142-4c04-9337-7c6b285e54e6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87245) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 12:48:41.221245 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-bebd3a48-a142-4c04-9337-7c6b285e54e6 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:48:41.222865 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-bebd3a48-a142-4c04-9337-7c6b285e54e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:48:41.344489 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:48:40 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 12:48:41.471399 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ac75f-f79b-4f7c-b0e0-e30262621056 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:41.545220 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: INFO dbcounter [None req-624ac75f-f79b-4f7c-b0e0-e30262621056 None None] Registered counter for database keystone Jul 14 12:48:41.564871 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG oslo_db.sqlalchemy.engines [None req-624ac75f-f79b-4f7c-b0e0-e30262621056 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87244) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 12:48:41.571123 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writer thread running {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 12:48:41.690295 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624ac75f-f79b-4f7c-b0e0-e30262621056 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:41.694593 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db684ae-9073-453c-98cc-9d48fe4731a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:41.695259 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db684ae-9073-453c-98cc-9d48fe4731a1 admin admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:41.695544 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db684ae-9073-453c-98cc-9d48fe4731a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:41.695818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db684ae-9073-453c-98cc-9d48fe4731a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:41.703893 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db684ae-9073-453c-98cc-9d48fe4731a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:41.755563 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1db684ae-9073-453c-98cc-9d48fe4731a1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 12:48:41.755911 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db684ae-9073-453c-98cc-9d48fe4731a1 admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:41.765521 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Thu Jul 14 12:48:41 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 12:48:41.771442 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd3a48-a142-4c04-9337-7c6b285e54e6 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:41.786100 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebd3a48-a142-4c04-9337-7c6b285e54e6 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:41.790628 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d616ce84-168e-436c-9d2d-e5585bb8638e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:41.791730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616ce84-168e-436c-9d2d-e5585bb8638e admin admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:41.792018 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616ce84-168e-436c-9d2d-e5585bb8638e admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:41.792298 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d616ce84-168e-436c-9d2d-e5585bb8638e admin admin] PATH_INFO: `/v3/projects/c24ba159095c44f2835516dff526567e` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:41.793949 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616ce84-168e-436c-9d2d-e5585bb8638e admin admin] RBAC: Authorizing `identity:get_project(project_id=c24ba159095c44f2835516dff526567e)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:41.847577 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d616ce84-168e-436c-9d2d-e5585bb8638e admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 14 12:48:41.847939 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d616ce84-168e-436c-9d2d-e5585bb8638e admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:41.852547 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Thu Jul 14 12:48:41 2022] GET /identity/v3/projects/c24ba159095c44f2835516dff526567e => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:48:44.045078 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fd0bb-705a-4788-8f7b-38f5f761bb70 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:44.045602 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fd0bb-705a-4788-8f7b-38f5f761bb70 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:44.045602 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23fd0bb-705a-4788-8f7b-38f5f761bb70 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:44.050233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:48:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:48:44.055740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23409870-304c-42ab-a811-d6396ad6b533 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:44.056153 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23409870-304c-42ab-a811-d6396ad6b533 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:44.056305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23409870-304c-42ab-a811-d6396ad6b533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:44.075632 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-23409870-304c-42ab-a811-d6396ad6b533 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:48:44.077215 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-23409870-304c-42ab-a811-d6396ad6b533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:48:44.085682 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:48:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 14 12:48:44.109482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fd0bb-705a-4788-8f7b-38f5f761bb70 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:44.121638 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23fd0bb-705a-4788-8f7b-38f5f761bb70 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:44.125993 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea1a24c-5eee-4b92-b37d-a52abc3d1428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:44.126624 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1a24c-5eee-4b92-b37d-a52abc3d1428 admin admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:44.126910 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1a24c-5eee-4b92-b37d-a52abc3d1428 admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:44.127192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea1a24c-5eee-4b92-b37d-a52abc3d1428 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:44.135223 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1a24c-5eee-4b92-b37d-a52abc3d1428 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:44.137075 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea1a24c-5eee-4b92-b37d-a52abc3d1428 admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:44.146579 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Thu Jul 14 12:48:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 14 12:48:44.152287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23409870-304c-42ab-a811-d6396ad6b533 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:44.162017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23409870-304c-42ab-a811-d6396ad6b533 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:44.166505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdddcae3-ce16-4979-818f-1a389b6d104d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:44.167357 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddcae3-ce16-4979-818f-1a389b6d104d admin admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:44.167643 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddcae3-ce16-4979-818f-1a389b6d104d admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:44.167920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdddcae3-ce16-4979-818f-1a389b6d104d admin admin] PATH_INFO: `/v3/users/ab5d7b1a37b74ac9a2830100d8a3e73f` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:44.169331 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddcae3-ce16-4979-818f-1a389b6d104d admin admin] RBAC: Authorizing `identity:get_user(user_id=ab5d7b1a37b74ac9a2830100d8a3e73f)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:44.171182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdddcae3-ce16-4979-818f-1a389b6d104d admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:44.172793 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Thu Jul 14 12:48:44 2022] GET /identity/v3/users/ab5d7b1a37b74ac9a2830100d8a3e73f => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:48:46.487787 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a70131-6e3e-46b0-a12f-1f55c7820ceb None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:46.488389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a70131-6e3e-46b0-a12f-1f55c7820ceb None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:46.488389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a70131-6e3e-46b0-a12f-1f55c7820ceb None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:46.489700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:48:46.490250 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ee6a6-ff23-4280-87a5-5085bd20531e None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:46.490636 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ee6a6-ff23-4280-87a5-5085bd20531e None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:46.490875 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0ee6a6-ff23-4280-87a5-5085bd20531e None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:46.492229 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:48:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:48:46.494670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41c44c-d131-4cc1-9838-6a7159a69d1d None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:46.495288 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41c44c-d131-4cc1-9838-6a7159a69d1d None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:46.495781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc41c44c-d131-4cc1-9838-6a7159a69d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:46.497809 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858dba0-19e9-4aaa-b4f5-6437e4e4c206 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:46.498109 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858dba0-19e9-4aaa-b4f5-6437e4e4c206 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:46.498404 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858dba0-19e9-4aaa-b4f5-6437e4e4c206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:46.516342 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-8858dba0-19e9-4aaa-b4f5-6437e4e4c206 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:48:46.517607 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-8858dba0-19e9-4aaa-b4f5-6437e4e4c206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:48:46.536532 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG passlib.handlers.bcrypt [None req-cc41c44c-d131-4cc1-9838-6a7159a69d1d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87244) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 14 12:48:46.536995 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG passlib.handlers.bcrypt [None req-cc41c44c-d131-4cc1-9838-6a7159a69d1d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87244) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 14 12:48:46.583196 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-cc41c44c-d131-4cc1-9838-6a7159a69d1d None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:48:46.584829 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-cc41c44c-d131-4cc1-9838-6a7159a69d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:48:46.596307 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 7/12] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:48:46.621355 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858dba0-19e9-4aaa-b4f5-6437e4e4c206 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:46.645783 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:46.685724 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 6/13] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:48:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:48:46.710231 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41c44c-d131-4cc1-9838-6a7159a69d1d None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:46.728256 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858dba0-19e9-4aaa-b4f5-6437e4e4c206 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:46.761965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea2bc7-f749-4c7e-abc1-62c98675034a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:46.762770 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea2bc7-f749-4c7e-abc1-62c98675034a None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:46.763051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea2bc7-f749-4c7e-abc1-62c98675034a None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:46.763340 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea2bc7-f749-4c7e-abc1-62c98675034a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:46.813776 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc41c44c-d131-4cc1-9838-6a7159a69d1d None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:46.816410 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:46.853363 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5bdae-7dbc-4d4a-9ac0-9d05d45d350a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:46.854283 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5bdae-7dbc-4d4a-9ac0-9d05d45d350a None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:46.854572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5bdae-7dbc-4d4a-9ac0-9d05d45d350a None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:46.854853 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b5bdae-7dbc-4d4a-9ac0-9d05d45d350a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:46.883276 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea2bc7-f749-4c7e-abc1-62c98675034a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:48:46.894282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-62ea2bc7-f749-4c7e-abc1-62c98675034a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:48:46.894282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:48:46.894282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:48:46.894282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:48:46.894282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:48:46.894282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:48:46.894282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:48:46.894282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:48:46.894282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:48:46.894282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:48:46.894282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:48:46.894282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:48:46.894282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:48:46.894282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:48:46.894282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:48:46.894282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:48:46.895242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:48:46.895242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:48:46.895242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:48:46.895242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:48:46.895242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:48:46.895242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:48:46.895242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:48:46.895242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:48:46.895242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:48:46.895242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:48:46.895242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:48:46.895242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:48:46.895242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:48:46.895242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:48:46.895242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:48:46.895242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:48:46.896216 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:48:46.896216 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:48:46.896216 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:48:46.896216 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:48:46.896216 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:48:46.896216 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:48:46.896216 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:48:46.896216 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:48:46.896216 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:48:46.896216 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:48:46.896216 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:48:46.896216 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:48:46.896216 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 8/14] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 12:48:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:48:46.901423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea2bc7-f749-4c7e-abc1-62c98675034a None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:46.926364 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5bdae-7dbc-4d4a-9ac0-9d05d45d350a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:46.927901 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b5bdae-7dbc-4d4a-9ac0-9d05d45d350a None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:46.984809 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:47.005027 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea2bc7-f749-4c7e-abc1-62c98675034a None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:47.033405 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 7/15] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:48:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 12:48:47.034832 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5bdae-7dbc-4d4a-9ac0-9d05d45d350a None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:47.038183 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:47.039401 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bd6be-0d37-4c89-89d7-00c565ba8ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:47.040064 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bd6be-0d37-4c89-89d7-00c565ba8ad9 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:47.040348 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bd6be-0d37-4c89-89d7-00c565ba8ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:47.040624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bd6be-0d37-4c89-89d7-00c565ba8ad9 None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:47.041408 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bd6be-0d37-4c89-89d7-00c565ba8ad9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:48:47.041716 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bd6be-0d37-4c89-89d7-00c565ba8ad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:47.043118 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bd6be-0d37-4c89-89d7-00c565ba8ad9 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:47.056183 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 9/16] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:48:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:48:47.062306 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bd6be-0d37-4c89-89d7-00c565ba8ad9 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:47.136385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b5bdae-7dbc-4d4a-9ac0-9d05d45d350a None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:47.167820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bd6be-0d37-4c89-89d7-00c565ba8ad9 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:47.171475 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de415dc2-d601-47df-ab12-9fd7fe694bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:47.172261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de415dc2-d601-47df-ab12-9fd7fe694bbc None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:47.172542 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de415dc2-d601-47df-ab12-9fd7fe694bbc None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:47.172855 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de415dc2-d601-47df-ab12-9fd7fe694bbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:47.193378 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de415dc2-d601-47df-ab12-9fd7fe694bbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:47.199447 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de415dc2-d601-47df-ab12-9fd7fe694bbc None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:47.203067 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023862c7-ee71-400a-afe3-f9402ec17918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:47.203938 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023862c7-ee71-400a-afe3-f9402ec17918 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:47.204222 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023862c7-ee71-400a-afe3-f9402ec17918 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:47.204498 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023862c7-ee71-400a-afe3-f9402ec17918 None admin] PATH_INFO: `/v3/users/ab5d7b1a37b74ac9a2830100d8a3e73f` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:47.205823 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023862c7-ee71-400a-afe3-f9402ec17918 None admin] RBAC: Authorizing `identity:get_user(user_id=ab5d7b1a37b74ac9a2830100d8a3e73f)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:47.207303 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023862c7-ee71-400a-afe3-f9402ec17918 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:47.209257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 10/17] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:48:47 2022] GET /identity/v3/users/ab5d7b1a37b74ac9a2830100d8a3e73f => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:48:47.214706 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023862c7-ee71-400a-afe3-f9402ec17918 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:47.216224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-de415dc2-d601-47df-ab12-9fd7fe694bbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:48:47.216224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:48:47.216224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:48:47.216224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:48:47.216224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:48:47.216224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:48:47.216224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:48:47.216224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:48:47.216224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:48:47.216224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:48:47.216224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:48:47.216224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:48:47.216224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:48:47.216224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:48:47.216224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:48:47.217081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:48:47.217081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:48:47.217081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:48:47.217081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:48:47.217081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:48:47.217081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:48:47.217081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:48:47.217081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:48:47.217081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:48:47.217081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:48:47.217081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:48:47.217081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:48:47.217081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:48:47.217081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:48:47.217081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:48:47.217081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:48:47.217081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:48:47.218375 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:48:47.218375 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:48:47.218375 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:48:47.218375 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:48:47.218375 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 8/18] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:48:47.223745 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de415dc2-d601-47df-ab12-9fd7fe694bbc None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:47.231817 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:47.283252 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:47.318104 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023862c7-ee71-400a-afe3-f9402ec17918 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:47.355281 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab6e62-a575-47bc-978c-54371347d09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:47.356176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab6e62-a575-47bc-978c-54371347d09d None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:47.356458 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab6e62-a575-47bc-978c-54371347d09d None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:47.356764 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ab6e62-a575-47bc-978c-54371347d09d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:47.358027 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab6e62-a575-47bc-978c-54371347d09d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:47.360154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ab6e62-a575-47bc-978c-54371347d09d None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:47.361876 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 11/19] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:48:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:48:47.368177 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab6e62-a575-47bc-978c-54371347d09d None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:47.433277 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de415dc2-d601-47df-ab12-9fd7fe694bbc None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:47.450759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:47.470969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa42c3-c985-48ae-a236-ef3cc81dadb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:47.471882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa42c3-c985-48ae-a236-ef3cc81dadb7 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:47.472262 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ab6e62-a575-47bc-978c-54371347d09d None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:47.472355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa42c3-c985-48ae-a236-ef3cc81dadb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:47.472839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa42c3-c985-48ae-a236-ef3cc81dadb7 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:47.474017 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa42c3-c985-48ae-a236-ef3cc81dadb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:48:47.474505 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa42c3-c985-48ae-a236-ef3cc81dadb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:47.476469 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa42c3-c985-48ae-a236-ef3cc81dadb7 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:47.495989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 9/20] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:48:47.507447 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97acef9-8b1c-4595-92c3-a1ee07fbbf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:47.508223 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97acef9-8b1c-4595-92c3-a1ee07fbbf96 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:47.508574 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97acef9-8b1c-4595-92c3-a1ee07fbbf96 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:47.508943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97acef9-8b1c-4595-92c3-a1ee07fbbf96 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:47.509872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97acef9-8b1c-4595-92c3-a1ee07fbbf96 None admin] RBAC: Adding query filter params (role.id=9bca71f77ac24a898d3445ab3c205809, scope.domain.id=default, user.id=ab5d7b1a37b74ac9a2830100d8a3e73f) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:48:47.510256 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97acef9-8b1c-4595-92c3-a1ee07fbbf96 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:47.511963 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97acef9-8b1c-4595-92c3-a1ee07fbbf96 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:47.519929 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 12/21] 10.222.0.40 () {56 vars in 1322 bytes} [Thu Jul 14 12:48:47 2022] GET /identity/v3/role_assignments?user.id=ab5d7b1a37b74ac9a2830100d8a3e73f&scope.domain.id=default&role.id=9bca71f77ac24a898d3445ab3c205809 => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:48:50.134375 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16874ddc-9d78-4375-bdb9-5ec2521d9421 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:50.135653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16874ddc-9d78-4375-bdb9-5ec2521d9421 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:50.141278 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16874ddc-9d78-4375-bdb9-5ec2521d9421 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:50.147227 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 10/22] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:48:50 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:48:50.152850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafa728-bd0e-4ec2-a7bf-8d72b1153ba0 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:50.153721 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafa728-bd0e-4ec2-a7bf-8d72b1153ba0 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:50.154217 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caafa728-bd0e-4ec2-a7bf-8d72b1153ba0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:50.177809 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-caafa728-bd0e-4ec2-a7bf-8d72b1153ba0 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:48:50.179447 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-caafa728-bd0e-4ec2-a7bf-8d72b1153ba0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:48:50.279290 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 13/23] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:48:50.319238 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16874ddc-9d78-4375-bdb9-5ec2521d9421 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:50.399271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cde8a-0c0b-42c7-a598-1e56ad4b84fd None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:50.399632 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cde8a-0c0b-42c7-a598-1e56ad4b84fd None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:50.400121 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3cde8a-0c0b-42c7-a598-1e56ad4b84fd None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:50.401703 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 14/24] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:48:50.410592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482781b-f3da-4359-9a2c-bdbfd349bfa7 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:50.411188 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482781b-f3da-4359-9a2c-bdbfd349bfa7 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:50.411705 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1482781b-f3da-4359-9a2c-bdbfd349bfa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:50.465808 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-1482781b-f3da-4359-9a2c-bdbfd349bfa7 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:48:50.467382 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-1482781b-f3da-4359-9a2c-bdbfd349bfa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:48:50.470638 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16874ddc-9d78-4375-bdb9-5ec2521d9421 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:50.517039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:50.562670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e313a6-c8fb-486c-9cea-842f10274652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:50.563479 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e313a6-c8fb-486c-9cea-842f10274652 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:50.568012 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e313a6-c8fb-486c-9cea-842f10274652 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:50.568012 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e313a6-c8fb-486c-9cea-842f10274652 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:50.597732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e313a6-c8fb-486c-9cea-842f10274652 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:48:50.615135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-47e313a6-c8fb-486c-9cea-842f10274652 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:48:50.615135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:48:50.615135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:48:50.615135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:48:50.615135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:48:50.615135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:48:50.615135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:48:50.615135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:48:50.615135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:48:50.615135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:48:50.615135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:48:50.615135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:48:50.615135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:48:50.615135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:48:50.615135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:48:50.615135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:48:50.616019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:48:50.616019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:48:50.616019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:48:50.616019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:48:50.616019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:48:50.616019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:48:50.616019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:48:50.616019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:48:50.616019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:48:50.616019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:48:50.616019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:48:50.616019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:48:50.616019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:48:50.616019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:48:50.616019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:48:50.616019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:48:50.616787 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:48:50.616787 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:48:50.616787 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:48:50.616787 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:48:50.616787 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:48:50.616787 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:48:50.616787 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:48:50.616787 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:48:50.616787 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:48:50.616787 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:48:50.616787 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:48:50.616787 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:48:50.617371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 11/25] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 12:48:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:48:50.623216 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e313a6-c8fb-486c-9cea-842f10274652 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:50.625180 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 15/26] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:48:50.662798 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482781b-f3da-4359-9a2c-bdbfd349bfa7 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:50.669708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:50.808490 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e313a6-c8fb-486c-9cea-842f10274652 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:50.817003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1482781b-f3da-4359-9a2c-bdbfd349bfa7 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:50.851499 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468520e5-a570-471c-81e1-8712b23cf82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:50.852290 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468520e5-a570-471c-81e1-8712b23cf82b None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:50.852726 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468520e5-a570-471c-81e1-8712b23cf82b None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:50.853269 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468520e5-a570-471c-81e1-8712b23cf82b None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:50.854517 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468520e5-a570-471c-81e1-8712b23cf82b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:48:50.855159 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468520e5-a570-471c-81e1-8712b23cf82b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:50.856808 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468520e5-a570-471c-81e1-8712b23cf82b None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:50.860006 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881465e-0e8b-4553-ad35-f01f541e7329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:50.861538 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881465e-0e8b-4553-ad35-f01f541e7329 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:50.861997 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881465e-0e8b-4553-ad35-f01f541e7329 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:50.862463 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881465e-0e8b-4553-ad35-f01f541e7329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:50.871615 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 12/27] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:48:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:48:50.873693 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7c4f-a21e-4bda-8c7a-1d803a46cb24 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:50.874198 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7c4f-a21e-4bda-8c7a-1d803a46cb24 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:50.874632 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf7c4f-a21e-4bda-8c7a-1d803a46cb24 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:50.876041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 13/28] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:48:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:48:50.878266 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9f89f-0dea-4d13-8fd9-413e268ee29e None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:50.879449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881465e-0e8b-4553-ad35-f01f541e7329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:50.881145 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881465e-0e8b-4553-ad35-f01f541e7329 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:50.881933 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9f89f-0dea-4d13-8fd9-413e268ee29e None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:50.882217 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9f89f-0dea-4d13-8fd9-413e268ee29e None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:50.883659 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 14/29] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:48:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:48:50.884188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9f89f-0dea-4d13-8fd9-413e268ee29e None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:50.909110 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-0881465e-0e8b-4553-ad35-f01f541e7329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:48:50.909110 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:48:50.909110 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:48:50.909110 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:48:50.909110 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:48:50.909110 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:48:50.909110 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:48:50.909110 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:48:50.909110 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:48:50.909110 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:48:50.909110 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:48:50.909110 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:48:50.909110 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:48:50.909110 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:48:50.909110 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:48:50.909977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:48:50.909977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:48:50.909977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:48:50.909977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:48:50.909977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:48:50.909977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:48:50.909977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:48:50.909977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:48:50.909977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:48:50.909977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:48:50.909977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:48:50.909977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:48:50.909977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:48:50.909977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:48:50.909977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:48:50.909977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:48:50.909977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:48:50.910792 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:48:50.910792 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:48:50.910792 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:48:50.910792 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:48:50.910792 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 16/30] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:48:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:48:50.916168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec82fd-8585-4c38-8492-08c5de370456 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:50.916168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec82fd-8585-4c38-8492-08c5de370456 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:50.916168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ec82fd-8585-4c38-8492-08c5de370456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:50.936237 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-f3ec82fd-8585-4c38-8492-08c5de370456 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:48:50.937516 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-f3ec82fd-8585-4c38-8492-08c5de370456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:48:50.950432 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:51.000464 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:51.024683 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 17/31] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:48:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:48:51.024683 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eeba4-a03d-4019-9d11-149158f9ac1f None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:51.024683 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eeba4-a03d-4019-9d11-149158f9ac1f None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:51.024683 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eeba4-a03d-4019-9d11-149158f9ac1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:51.049449 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9f89f-0dea-4d13-8fd9-413e268ee29e None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:51.053816 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-7d1eeba4-a03d-4019-9d11-149158f9ac1f None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:48:51.055273 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-7d1eeba4-a03d-4019-9d11-149158f9ac1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:48:51.085757 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c19d3-4627-4f38-bf6e-023a08c01cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:51.086628 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c19d3-4627-4f38-bf6e-023a08c01cbf None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:51.086912 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c19d3-4627-4f38-bf6e-023a08c01cbf None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:51.087186 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5c19d3-4627-4f38-bf6e-023a08c01cbf None admin] PATH_INFO: `/v3/users/ab5d7b1a37b74ac9a2830100d8a3e73f` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:51.088847 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c19d3-4627-4f38-bf6e-023a08c01cbf None admin] RBAC: Authorizing `identity:get_user(user_id=ab5d7b1a37b74ac9a2830100d8a3e73f)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:51.090384 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5c19d3-4627-4f38-bf6e-023a08c01cbf None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:51.092000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 15/32] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:48:50 2022] GET /identity/v3/users/ab5d7b1a37b74ac9a2830100d8a3e73f => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:48:51.093401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c19d3-4627-4f38-bf6e-023a08c01cbf None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:51.142009 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 18/33] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:48:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:48:51.143241 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1eeba4-a03d-4019-9d11-149158f9ac1f None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:51.205812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5c19d3-4627-4f38-bf6e-023a08c01cbf None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:51.213933 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:51.242215 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44e50d-577f-4b49-b50c-f5a44d05976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:51.242880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44e50d-577f-4b49-b50c-f5a44d05976d None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:51.243162 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44e50d-577f-4b49-b50c-f5a44d05976d None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:51.243437 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef44e50d-577f-4b49-b50c-f5a44d05976d None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:51.244175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44e50d-577f-4b49-b50c-f5a44d05976d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:48:51.244482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44e50d-577f-4b49-b50c-f5a44d05976d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:51.245888 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef44e50d-577f-4b49-b50c-f5a44d05976d None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:51.259487 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 16/34] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:48:51.260330 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44e50d-577f-4b49-b50c-f5a44d05976d None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:51.292024 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1eeba4-a03d-4019-9d11-149158f9ac1f None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:51.309743 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:51.328983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c86a64-2552-420f-b457-cab6b48075f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:51.329705 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c86a64-2552-420f-b457-cab6b48075f6 None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:51.330009 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c86a64-2552-420f-b457-cab6b48075f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:51.330294 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c86a64-2552-420f-b457-cab6b48075f6 None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:51.331020 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c86a64-2552-420f-b457-cab6b48075f6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:51.332582 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c86a64-2552-420f-b457-cab6b48075f6 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:51.375653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef44e50d-577f-4b49-b50c-f5a44d05976d None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:51.412361 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5521a-79df-4028-8254-94e81b39e6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:51.413572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5521a-79df-4028-8254-94e81b39e6b2 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:51.414006 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5521a-79df-4028-8254-94e81b39e6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:51.414449 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5521a-79df-4028-8254-94e81b39e6b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:51.415790 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5521a-79df-4028-8254-94e81b39e6b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:51.417815 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5521a-79df-4028-8254-94e81b39e6b2 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:51.419605 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 17/35] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:48:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:48:51.420481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5521a-79df-4028-8254-94e81b39e6b2 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:51.461248 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:51.532952 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5521a-79df-4028-8254-94e81b39e6b2 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:51.569137 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79645ce-aa6f-494d-a55d-0b805b1acdc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:51.570100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79645ce-aa6f-494d-a55d-0b805b1acdc1 None admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:51.570534 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79645ce-aa6f-494d-a55d-0b805b1acdc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:51.570959 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79645ce-aa6f-494d-a55d-0b805b1acdc1 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:51.571853 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79645ce-aa6f-494d-a55d-0b805b1acdc1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:51.573423 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79645ce-aa6f-494d-a55d-0b805b1acdc1 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:51.622725 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 19/36] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jul 14 12:48:51 2022] POST /identity/v3/roles => generated 219 bytes in 480 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:48:51.624021 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c86a64-2552-420f-b457-cab6b48075f6 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:51.807558 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 18/37] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jul 14 12:48:51 2022] POST /identity/v3/roles => generated 225 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:48:51.811962 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79645ce-aa6f-494d-a55d-0b805b1acdc1 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:51.867860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c86a64-2552-420f-b457-cab6b48075f6 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:51.918867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7aac02-0be4-4639-a308-4bf831eb0826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:51.919569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7aac02-0be4-4639-a308-4bf831eb0826 None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:51.919891 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7aac02-0be4-4639-a308-4bf831eb0826 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:51.920178 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7aac02-0be4-4639-a308-4bf831eb0826 None admin] PATH_INFO: `/v3/projects` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:51.921046 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7aac02-0be4-4639-a308-4bf831eb0826 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:51.922750 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7aac02-0be4-4639-a308-4bf831eb0826 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:51.948376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:51.958194 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79645ce-aa6f-494d-a55d-0b805b1acdc1 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:51.996487 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb69d5-2f20-4ce4-bea3-762373b479e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:51.997408 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb69d5-2f20-4ce4-bea3-762373b479e0 None admin] REQUEST_METHOD: `PUT` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:51.997696 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb69d5-2f20-4ce4-bea3-762373b479e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:51.997978 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb69d5-2f20-4ce4-bea3-762373b479e0 None admin] PATH_INFO: `/v3/domains/default/users/ab5d7b1a37b74ac9a2830100d8a3e73f/roles/9bca71f77ac24a898d3445ab3c205809` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:52.000778 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb69d5-2f20-4ce4-bea3-762373b479e0 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ab5d7b1a37b74ac9a2830100d8a3e73f, role_id=9bca71f77ac24a898d3445ab3c205809)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:52.002366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb69d5-2f20-4ce4-bea3-762373b479e0 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:52.088661 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 20/38] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 12:48:51 2022] POST /identity/v3/projects => generated 301 bytes in 465 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:48:52.089890 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09efb1-b32e-42e9-b412-b30d92662386 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:52.090189 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09efb1-b32e-42e9-b412-b30d92662386 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:52.090472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa09efb1-b32e-42e9-b412-b30d92662386 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:52.091898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 21/39] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:48:52.093486 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee019064-2c40-4d22-af0f-30bfcf21be1a None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:52.093782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee019064-2c40-4d22-af0f-30bfcf21be1a None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:52.094072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee019064-2c40-4d22-af0f-30bfcf21be1a None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:52.095658 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 22/40] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:48:52.099517 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb35726-4032-4245-b3b9-b843ca806ae5 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:52.099899 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb35726-4032-4245-b3b9-b843ca806ae5 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:52.100232 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb35726-4032-4245-b3b9-b843ca806ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:52.116596 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 19/41] 10.222.0.40 () {58 vars in 1361 bytes} [Thu Jul 14 12:48:51 2022] PUT /identity/v3/domains/default/users/ab5d7b1a37b74ac9a2830100d8a3e73f/roles/9bca71f77ac24a898d3445ab3c205809 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:48:52.118274 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c9ce7-19ba-4ae7-a3ac-5104580df4fa None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:52.118578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c9ce7-19ba-4ae7-a3ac-5104580df4fa None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:52.118968 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24c9ce7-19ba-4ae7-a3ac-5104580df4fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:52.126083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-2fb35726-4032-4245-b3b9-b843ca806ae5 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:48:52.127739 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-2fb35726-4032-4245-b3b9-b843ca806ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:48:52.145623 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-a24c9ce7-19ba-4ae7-a3ac-5104580df4fa None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:48:52.148122 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-a24c9ce7-19ba-4ae7-a3ac-5104580df4fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:48:52.173914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:52.236670 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 23/42] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:48:52.237641 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 20/43] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:48:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:48:52.257462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb35726-4032-4245-b3b9-b843ca806ae5 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:52.259488 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c9ce7-19ba-4ae7-a3ac-5104580df4fa None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:52.375228 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:52.392149 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24c9ce7-19ba-4ae7-a3ac-5104580df4fa None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:52.397462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb35726-4032-4245-b3b9-b843ca806ae5 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:52.432734 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b606da0-bc73-4d20-886a-354ca7290449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:52.433418 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b606da0-bc73-4d20-886a-354ca7290449 None admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:52.433708 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b606da0-bc73-4d20-886a-354ca7290449 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:52.433995 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b606da0-bc73-4d20-886a-354ca7290449 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:52.434719 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5865e9-5563-45cf-b2cb-d567cfc780d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:52.434840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b606da0-bc73-4d20-886a-354ca7290449 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:52.435521 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5865e9-5563-45cf-b2cb-d567cfc780d9 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:52.435812 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5865e9-5563-45cf-b2cb-d567cfc780d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:52.436090 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5865e9-5563-45cf-b2cb-d567cfc780d9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:52.436219 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b606da0-bc73-4d20-886a-354ca7290449 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:52.438014 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5865e9-5563-45cf-b2cb-d567cfc780d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:52.439483 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5865e9-5563-45cf-b2cb-d567cfc780d9 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:52.441231 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 24/44] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:48:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:48:52.446952 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5865e9-5563-45cf-b2cb-d567cfc780d9 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:52.477066 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:52.549937 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5865e9-5563-45cf-b2cb-d567cfc780d9 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:52.557416 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 21/45] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jul 14 12:48:52 2022] POST /identity/v3/roles => generated 223 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:48:52.588917 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f600784-ef7a-4d9f-921e-ad6edcd88f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:52.589902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f600784-ef7a-4d9f-921e-ad6edcd88f31 None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:52.590335 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f600784-ef7a-4d9f-921e-ad6edcd88f31 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:52.590864 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f600784-ef7a-4d9f-921e-ad6edcd88f31 None admin] PATH_INFO: `/v3/projects` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:52.591796 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f600784-ef7a-4d9f-921e-ad6edcd88f31 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:52.594137 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f600784-ef7a-4d9f-921e-ad6edcd88f31 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:52.751527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 25/46] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 12:48:52 2022] POST /identity/v3/projects => generated 312 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:48:54.439719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f4145-ad63-4957-b30d-82cbf34e1dee None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:54.440207 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f4145-ad63-4957-b30d-82cbf34e1dee None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:54.440207 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04f4145-ad63-4957-b30d-82cbf34e1dee None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:54.441582 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 22/47] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:48:54.446892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee47713-e924-4d39-bd81-a089b717cc1c None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:54.447457 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee47713-e924-4d39-bd81-a089b717cc1c None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:54.447457 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee47713-e924-4d39-bd81-a089b717cc1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:54.464534 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-3ee47713-e924-4d39-bd81-a089b717cc1c None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:48:54.465737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-3ee47713-e924-4d39-bd81-a089b717cc1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:48:54.532276 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 26/48] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:48:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:48:54.556616 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f4145-ad63-4957-b30d-82cbf34e1dee None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:54.660805 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04f4145-ad63-4957-b30d-82cbf34e1dee None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:54.694976 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870447dc-ba48-4a68-8ddf-071af2c1efa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:54.695693 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870447dc-ba48-4a68-8ddf-071af2c1efa8 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:54.696005 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870447dc-ba48-4a68-8ddf-071af2c1efa8 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:54.696260 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870447dc-ba48-4a68-8ddf-071af2c1efa8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:54.707297 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870447dc-ba48-4a68-8ddf-071af2c1efa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:48:54.715341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-870447dc-ba48-4a68-8ddf-071af2c1efa8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:48:54.715341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:48:54.715341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:48:54.715341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:48:54.715341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:48:54.715341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:48:54.715341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:48:54.715341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:48:54.715341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:48:54.715341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:48:54.715341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:48:54.715341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:48:54.715341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:48:54.715341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:48:54.715341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:48:54.715341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:48:54.716337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:48:54.716337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:48:54.716337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:48:54.716337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:48:54.716337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:48:54.716337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:48:54.716337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:48:54.716337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:48:54.716337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:48:54.716337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:48:54.716337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:48:54.716337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:48:54.716337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:48:54.716337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:48:54.716337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:48:54.716337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:48:54.717309 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:48:54.717309 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:48:54.717309 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:48:54.717309 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:48:54.717309 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:48:54.717309 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:48:54.717309 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:48:54.717309 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:48:54.717309 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:48:54.717309 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:48:54.717309 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:48:54.717309 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:48:54.717309 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 23/49] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 12:48:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:48:54.724571 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee47713-e924-4d39-bd81-a089b717cc1c None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:54.735539 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:54.825884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee47713-e924-4d39-bd81-a089b717cc1c None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:54.864975 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f798a2-f20e-4555-8af3-71d6c7c22230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:54.865658 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f798a2-f20e-4555-8af3-71d6c7c22230 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:54.865951 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f798a2-f20e-4555-8af3-71d6c7c22230 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:54.866238 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f798a2-f20e-4555-8af3-71d6c7c22230 None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:54.867007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f798a2-f20e-4555-8af3-71d6c7c22230 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:48:54.867322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f798a2-f20e-4555-8af3-71d6c7c22230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:54.868795 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f798a2-f20e-4555-8af3-71d6c7c22230 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:54.877642 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 27/50] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:48:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:48:54.883167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870447dc-ba48-4a68-8ddf-071af2c1efa8 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:54.887001 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:54.981654 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870447dc-ba48-4a68-8ddf-071af2c1efa8 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:54.997559 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f8e88-3f71-42d6-9479-cc3c25631e7f None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:54.997862 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f8e88-3f71-42d6-9479-cc3c25631e7f None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:54.998140 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804f8e88-3f71-42d6-9479-cc3c25631e7f None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:54.999554 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 28/51] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:48:55.004422 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce4cea-3dd8-407d-a9eb-9463adc709ec None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:55.004750 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce4cea-3dd8-407d-a9eb-9463adc709ec None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:55.005043 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ce4cea-3dd8-407d-a9eb-9463adc709ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:55.018160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8533e3-5314-47cb-9a41-a052b9529f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:55.019030 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8533e3-5314-47cb-9a41-a052b9529f18 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:55.019320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8533e3-5314-47cb-9a41-a052b9529f18 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:55.019597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8533e3-5314-47cb-9a41-a052b9529f18 None admin] PATH_INFO: `/v3/users/ab5d7b1a37b74ac9a2830100d8a3e73f` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:55.020844 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8533e3-5314-47cb-9a41-a052b9529f18 None admin] RBAC: Authorizing `identity:get_user(user_id=ab5d7b1a37b74ac9a2830100d8a3e73f)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:55.021635 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-a6ce4cea-3dd8-407d-a9eb-9463adc709ec None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:48:55.022324 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8533e3-5314-47cb-9a41-a052b9529f18 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:55.022859 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-a6ce4cea-3dd8-407d-a9eb-9463adc709ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:48:55.024003 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 24/52] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:48:54 2022] GET /identity/v3/users/ab5d7b1a37b74ac9a2830100d8a3e73f => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:48:55.029555 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8533e3-5314-47cb-9a41-a052b9529f18 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:55.091313 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:55.097923 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 29/53] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:48:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:48:55.106184 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:55.124943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce4cea-3dd8-407d-a9eb-9463adc709ec None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:55.182956 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8533e3-5314-47cb-9a41-a052b9529f18 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:55.182956 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74f3d5-2efc-4377-ae53-644891dd538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:55.182956 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74f3d5-2efc-4377-ae53-644891dd538a None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:55.182956 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74f3d5-2efc-4377-ae53-644891dd538a None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:55.184180 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74f3d5-2efc-4377-ae53-644891dd538a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:55.184180 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74f3d5-2efc-4377-ae53-644891dd538a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:55.184180 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74f3d5-2efc-4377-ae53-644891dd538a None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:55.184180 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 25/54] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:48:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:48:55.188159 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74f3d5-2efc-4377-ae53-644891dd538a None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:55.230707 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ce4cea-3dd8-407d-a9eb-9463adc709ec None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:55.270819 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f9fdd-a7d3-4bae-b712-4511f5909f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:55.271626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f9fdd-a7d3-4bae-b712-4511f5909f45 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:55.271919 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f9fdd-a7d3-4bae-b712-4511f5909f45 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:55.272201 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1f9fdd-a7d3-4bae-b712-4511f5909f45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:55.273452 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f9fdd-a7d3-4bae-b712-4511f5909f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:55.274960 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1f9fdd-a7d3-4bae-b712-4511f5909f45 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:55.276627 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 30/55] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:48:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:48:55.282207 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f9fdd-a7d3-4bae-b712-4511f5909f45 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:55.292882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74f3d5-2efc-4377-ae53-644891dd538a None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:55.328533 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b83b4-4631-48c4-bf1c-e8a7396cb77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:55.329224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b83b4-4631-48c4-bf1c-e8a7396cb77b None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:55.329516 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b83b4-4631-48c4-bf1c-e8a7396cb77b None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:55.329800 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b83b4-4631-48c4-bf1c-e8a7396cb77b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:55.330635 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b83b4-4631-48c4-bf1c-e8a7396cb77b None admin] RBAC: Adding query filter params (role.id=9bca71f77ac24a898d3445ab3c205809, scope.domain.id=default, user.id=ab5d7b1a37b74ac9a2830100d8a3e73f) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:48:55.330952 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b83b4-4631-48c4-bf1c-e8a7396cb77b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:55.332402 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b83b4-4631-48c4-bf1c-e8a7396cb77b None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:55.340650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 26/56] 10.222.0.40 () {56 vars in 1322 bytes} [Thu Jul 14 12:48:55 2022] GET /identity/v3/role_assignments?user.id=ab5d7b1a37b74ac9a2830100d8a3e73f&scope.domain.id=default&role.id=9bca71f77ac24a898d3445ab3c205809 => generated 530 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:48:55.352683 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:55.390768 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1f9fdd-a7d3-4bae-b712-4511f5909f45 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:55.430610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a34635-20f6-4924-8af2-5386548d79f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:55.431277 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a34635-20f6-4924-8af2-5386548d79f5 None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:55.431560 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a34635-20f6-4924-8af2-5386548d79f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:55.431833 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a34635-20f6-4924-8af2-5386548d79f5 None admin] PATH_INFO: `/v3/projects` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:55.432554 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a34635-20f6-4924-8af2-5386548d79f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:55.434079 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a34635-20f6-4924-8af2-5386548d79f5 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:55.527955 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 31/57] 10.222.0.40 () {60 vars in 1140 bytes} [Thu Jul 14 12:48:55 2022] POST /identity/v3/projects => generated 298 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:48:57.775048 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ec756-046a-4a12-9dd2-fae7cefe0f81 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:57.775571 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ec756-046a-4a12-9dd2-fae7cefe0f81 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:57.775679 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64ec756-046a-4a12-9dd2-fae7cefe0f81 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:57.777066 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 27/58] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:48:57.783069 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8f5cb-70a8-4362-abe3-f68b9370cbf5 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:57.783482 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8f5cb-70a8-4362-abe3-f68b9370cbf5 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:57.783630 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e8f5cb-70a8-4362-abe3-f68b9370cbf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:57.800500 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-14e8f5cb-70a8-4362-abe3-f68b9370cbf5 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:48:57.801711 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-14e8f5cb-70a8-4362-abe3-f68b9370cbf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:48:57.865116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 32/59] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:48:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:48:57.892046 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ec756-046a-4a12-9dd2-fae7cefe0f81 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:57.896071 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:57.992153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64ec756-046a-4a12-9dd2-fae7cefe0f81 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:58.024312 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd68a534-111b-4f87-a28f-fabb525420f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:58.025174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68a534-111b-4f87-a28f-fabb525420f0 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:58.025412 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68a534-111b-4f87-a28f-fabb525420f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:58.025689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd68a534-111b-4f87-a28f-fabb525420f0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:58.026866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68a534-111b-4f87-a28f-fabb525420f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:58.028349 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd68a534-111b-4f87-a28f-fabb525420f0 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:58.029997 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 28/60] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:48:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:48:58.036195 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8f5cb-70a8-4362-abe3-f68b9370cbf5 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:48:58.087050 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:48:58.140025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e8f5cb-70a8-4362-abe3-f68b9370cbf5 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:48:58.173609 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e69d4-21a7-46ff-80fc-49ac46930bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:48:58.174280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e69d4-21a7-46ff-80fc-49ac46930bf6 None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:48:58.174572 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e69d4-21a7-46ff-80fc-49ac46930bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:48:58.174854 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e69d4-21a7-46ff-80fc-49ac46930bf6 None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:48:58.175577 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e69d4-21a7-46ff-80fc-49ac46930bf6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:48:58.177070 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e69d4-21a7-46ff-80fc-49ac46930bf6 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:48:58.303571 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 33/61] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 12:48:58 2022] POST /identity/v3/users => generated 275 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:49:01.775621 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b92fd-f394-4ebc-bcd8-7dcd5812df09 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:01.776780 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b92fd-f394-4ebc-bcd8-7dcd5812df09 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:01.777295 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223b92fd-f394-4ebc-bcd8-7dcd5812df09 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:01.779485 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 29/62] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:01.785891 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f0bb5-a860-47ab-a35d-93185ec09c85 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:01.787229 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f0bb5-a860-47ab-a35d-93185ec09c85 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:01.787229 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f0bb5-a860-47ab-a35d-93185ec09c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:01.816666 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-dc3f0bb5-a860-47ab-a35d-93185ec09c85 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:01.818247 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-dc3f0bb5-a860-47ab-a35d-93185ec09c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:01.892730 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03205f91-f90a-4cd5-87dd-05f7eb7aa167 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:01.893420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03205f91-f90a-4cd5-87dd-05f7eb7aa167 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:01.893917 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03205f91-f90a-4cd5-87dd-05f7eb7aa167 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:01.895565 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 30/63] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:49:01.901391 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8dcc1-1482-4d0f-89fe-99e0f28404aa None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:01.902031 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8dcc1-1482-4d0f-89fe-99e0f28404aa None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:01.902535 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be8dcc1-1482-4d0f-89fe-99e0f28404aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:01.921331 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-2be8dcc1-1482-4d0f-89fe-99e0f28404aa None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:01.922913 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-2be8dcc1-1482-4d0f-89fe-99e0f28404aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:01.939579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 34/64] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:01.975020 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f0bb5-a860-47ab-a35d-93185ec09c85 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:02.043654 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 31/65] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:02.045011 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:02.082968 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8dcc1-1482-4d0f-89fe-99e0f28404aa None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:02.087546 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:02.135030 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f0bb5-a860-47ab-a35d-93185ec09c85 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:02.178328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c705b-303a-4786-ada1-ac6c78443b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:02.179546 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c705b-303a-4786-ada1-ac6c78443b91 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:02.180106 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c705b-303a-4786-ada1-ac6c78443b91 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:02.180807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c705b-303a-4786-ada1-ac6c78443b91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:02.194774 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c705b-303a-4786-ada1-ac6c78443b91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:02.204002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-690c705b-303a-4786-ada1-ac6c78443b91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:49:02.204002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:02.204002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:02.204002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:02.204002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:02.204002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:02.204002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:02.204002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:02.204002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:02.204002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:02.204002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:02.204002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:02.204002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:02.204002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:02.204002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:02.204002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:02.205228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:02.205228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:02.205228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:02.205228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:02.205228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:02.205228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:02.205228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:02.205228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:02.205228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:02.205228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:02.205228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:02.205228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:02.205228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:02.205228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:02.205228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:02.205228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:02.206017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:02.206017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:02.206017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:02.206017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:02.206017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:02.206017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:02.206017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:02.206017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:02.206017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:02.206017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:02.206017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:49:02.206017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:02.209226 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 35/66] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 12:49:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:49:02.215896 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dc0d8-e1f8-4104-95c7-953a88fb068c None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:02.216538 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dc0d8-e1f8-4104-95c7-953a88fb068c None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:02.217072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465dc0d8-e1f8-4104-95c7-953a88fb068c None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:02.219056 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 36/67] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:02.220118 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dc0d8-e1f8-4104-95c7-953a88fb068c None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:02.238815 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be8dcc1-1482-4d0f-89fe-99e0f28404aa None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:02.281806 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f150cc96-a6f1-4a2c-a08f-944f207f632b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:02.282609 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150cc96-a6f1-4a2c-a08f-944f207f632b None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:02.282894 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150cc96-a6f1-4a2c-a08f-944f207f632b None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:02.283168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f150cc96-a6f1-4a2c-a08f-944f207f632b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:02.297013 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f150cc96-a6f1-4a2c-a08f-944f207f632b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:02.306037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-f150cc96-a6f1-4a2c-a08f-944f207f632b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:02.306037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:02.306037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:02.306037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:02.306037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:02.306037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:02.306037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:02.306037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:02.306037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:02.306037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:02.306037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:02.306037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:02.306037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:02.306037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:02.306037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:02.306037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:02.306918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:02.306918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:02.306918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:02.306918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:02.306918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:02.306918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:02.306918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:02.306918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:02.306918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:02.306918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:02.306918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:02.306918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:02.306918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:02.306918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:02.306918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:02.306918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:02.307718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:02.307718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:02.307718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:02.307718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:02.307718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:02.307718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:02.307718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:02.307718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:02.307718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:02.307718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:02.307718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:02.307718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:02.307718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 32/68] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:49:02.308879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9258683-aed4-45ed-a956-9e578d0ce926 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:02.309116 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9258683-aed4-45ed-a956-9e578d0ce926 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:02.309388 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9258683-aed4-45ed-a956-9e578d0ce926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:02.331877 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:02.335874 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-d9258683-aed4-45ed-a956-9e578d0ce926 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:02.342179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-d9258683-aed4-45ed-a956-9e578d0ce926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:02.342305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465dc0d8-e1f8-4104-95c7-953a88fb068c None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:02.379585 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b9c59-ff57-42ca-ac5e-6cc14194cbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:02.380436 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b9c59-ff57-42ca-ac5e-6cc14194cbfc None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:02.380902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b9c59-ff57-42ca-ac5e-6cc14194cbfc None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:02.381389 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1b9c59-ff57-42ca-ac5e-6cc14194cbfc None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:02.382509 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b9c59-ff57-42ca-ac5e-6cc14194cbfc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:02.383032 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b9c59-ff57-42ca-ac5e-6cc14194cbfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:02.384615 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1b9c59-ff57-42ca-ac5e-6cc14194cbfc None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:02.398162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 37/69] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:02.398162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b9c59-ff57-42ca-ac5e-6cc14194cbfc None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:02.412009 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:02.422608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 33/70] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:02.430654 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec7e82-ab57-4ec4-a490-073e24172747 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:02.431639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec7e82-ab57-4ec4-a490-073e24172747 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:02.432406 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec7e82-ab57-4ec4-a490-073e24172747 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:02.434083 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 34/71] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:02 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:02.436229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec7e82-ab57-4ec4-a490-073e24172747 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:02.507508 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1b9c59-ff57-42ca-ac5e-6cc14194cbfc None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:02.549227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae59923d-0f3a-4360-a5ae-fbade2b635ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:02.550223 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59923d-0f3a-4360-a5ae-fbade2b635ad None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:02.550680 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59923d-0f3a-4360-a5ae-fbade2b635ad None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:02.551116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae59923d-0f3a-4360-a5ae-fbade2b635ad None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:02.552167 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59923d-0f3a-4360-a5ae-fbade2b635ad None admin] RBAC: Adding query filter params (name=member) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:02.552759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59923d-0f3a-4360-a5ae-fbade2b635ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:02.554360 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae59923d-0f3a-4360-a5ae-fbade2b635ad None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:02.556234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec7e82-ab57-4ec4-a490-073e24172747 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:02.565159 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 38/72] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:02.566796 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da160f3-4c36-42ee-bc41-3c180e1f7309 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:02.567087 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da160f3-4c36-42ee-bc41-3c180e1f7309 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:02.567370 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da160f3-4c36-42ee-bc41-3c180e1f7309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:02.586347 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-6da160f3-4c36-42ee-bc41-3c180e1f7309 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:02.587683 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-6da160f3-4c36-42ee-bc41-3c180e1f7309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:02.595327 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4aaa40-f2d9-446b-a187-f6782a5f5126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:02.596211 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4aaa40-f2d9-446b-a187-f6782a5f5126 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:02.596595 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4aaa40-f2d9-446b-a187-f6782a5f5126 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:02.596826 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4aaa40-f2d9-446b-a187-f6782a5f5126 None admin] PATH_INFO: `/v3/users/ab5d7b1a37b74ac9a2830100d8a3e73f` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:02.598007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4aaa40-f2d9-446b-a187-f6782a5f5126 None admin] RBAC: Authorizing `identity:get_user(user_id=ab5d7b1a37b74ac9a2830100d8a3e73f)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:02.599477 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4aaa40-f2d9-446b-a187-f6782a5f5126 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:02.601312 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 35/73] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:02 2022] GET /identity/v3/users/ab5d7b1a37b74ac9a2830100d8a3e73f => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:02.602000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4aaa40-f2d9-446b-a187-f6782a5f5126 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:02.608834 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:02.665922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:02.669508 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 39/74] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:02.670326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da160f3-4c36-42ee-bc41-3c180e1f7309 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:02.714582 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4aaa40-f2d9-446b-a187-f6782a5f5126 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:02.748470 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610caac1-7256-4785-a8b9-20e5420a14f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:02.749501 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610caac1-7256-4785-a8b9-20e5420a14f8 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:02.749792 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610caac1-7256-4785-a8b9-20e5420a14f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:02.750074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610caac1-7256-4785-a8b9-20e5420a14f8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:02.760186 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610caac1-7256-4785-a8b9-20e5420a14f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:02.768801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-610caac1-7256-4785-a8b9-20e5420a14f8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:02.768801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:02.768801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:02.768801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:02.768801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:02.768801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:02.768801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:02.768801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:02.768801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:02.768801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:02.768801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:02.768801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:02.768801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:02.768801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:02.768801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:02.768801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:02.769692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:02.769692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:02.769692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:02.769692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:02.769692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:02.769692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:02.769692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:02.769692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:02.769692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:02.769692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:02.769692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:02.769692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:02.769692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:02.769692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:02.769692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:02.769692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:02.770531 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:02.770531 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:02.770531 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:02.770531 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:02.770531 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:02.770531 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:02.770531 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:02.770531 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:02.770531 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:02.770531 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:02.770531 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:02.770531 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:02.770531 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 36/75] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:49:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:02.771156 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610caac1-7256-4785-a8b9-20e5420a14f8 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:02.782354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da160f3-4c36-42ee-bc41-3c180e1f7309 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:02.816346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688606fb-6c4a-4c56-afae-3709f61f72ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:02.817179 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688606fb-6c4a-4c56-afae-3709f61f72ca None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:02.817486 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688606fb-6c4a-4c56-afae-3709f61f72ca None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:02.817741 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688606fb-6c4a-4c56-afae-3709f61f72ca None admin] PATH_INFO: `/v3/users/1a085e27599f4ca2adeff79d06f81706` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:02.831484 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688606fb-6c4a-4c56-afae-3709f61f72ca None admin] RBAC: Authorizing `identity:get_user(user_id=1a085e27599f4ca2adeff79d06f81706)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:02.833333 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688606fb-6c4a-4c56-afae-3709f61f72ca None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:02.834994 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 40/76] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:02 2022] GET /identity/v3/users/1a085e27599f4ca2adeff79d06f81706 => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:02.836218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dd94a-b68e-4431-a9cb-315c6b3ee665 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:02.836618 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dd94a-b68e-4431-a9cb-315c6b3ee665 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:02.836871 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218dd94a-b68e-4431-a9cb-315c6b3ee665 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:02.838132 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 41/77] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:02.838834 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dd94a-b68e-4431-a9cb-315c6b3ee665 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:02.850799 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:02.877643 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610caac1-7256-4785-a8b9-20e5420a14f8 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:02.899179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:02.914817 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389f1b9-e0f6-47e2-92e6-c257d8d23bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:02.915477 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389f1b9-e0f6-47e2-92e6-c257d8d23bd5 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:02.915766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389f1b9-e0f6-47e2-92e6-c257d8d23bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:02.916148 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6389f1b9-e0f6-47e2-92e6-c257d8d23bd5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:02.951618 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218dd94a-b68e-4431-a9cb-315c6b3ee665 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:02.985840 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e716d-7779-4cf8-996b-4df58679e310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:02.986655 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389f1b9-e0f6-47e2-92e6-c257d8d23bd5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:02.986766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e716d-7779-4cf8-996b-4df58679e310 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:02.986970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e716d-7779-4cf8-996b-4df58679e310 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:02.987250 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589e716d-7779-4cf8-996b-4df58679e310 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:02.988141 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6389f1b9-e0f6-47e2-92e6-c257d8d23bd5 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:02.997861 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589e716d-7779-4cf8-996b-4df58679e310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:03.005996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-589e716d-7779-4cf8-996b-4df58679e310 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:03.005996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:03.005996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:03.005996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:03.005996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:03.005996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:03.005996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:03.005996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:03.005996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:03.005996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:03.005996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:03.005996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:03.005996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:03.005996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:03.005996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:03.005996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:03.006934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:03.006934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:03.006934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:03.006934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:03.006934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:03.006934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:03.006934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:03.006934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:03.006934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:03.006934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:03.006934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:03.006934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:03.006934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:03.006934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:03.006934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:03.006934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:03.007759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:03.007759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:03.007759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:03.007759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:03.007759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:03.007759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:03.007759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:03.007759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:03.007759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:03.007759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:03.007759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:03.007759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:03.007759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 42/78] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:03.008390 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e716d-7779-4cf8-996b-4df58679e310 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:03.081347 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:03.089634 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 37/79] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:03.090582 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389f1b9-e0f6-47e2-92e6-c257d8d23bd5 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:03.111464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:03.115667 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589e716d-7779-4cf8-996b-4df58679e310 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:03.151966 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35436b28-384d-4908-8643-fc55ae9f904b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:03.152734 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35436b28-384d-4908-8643-fc55ae9f904b None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:03.153031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35436b28-384d-4908-8643-fc55ae9f904b None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:03.153318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35436b28-384d-4908-8643-fc55ae9f904b None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:03.154070 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35436b28-384d-4908-8643-fc55ae9f904b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:03.154384 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35436b28-384d-4908-8643-fc55ae9f904b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:03.156396 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35436b28-384d-4908-8643-fc55ae9f904b None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:03.164419 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 43/80] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:49:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:03.165705 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7db3dd-a48e-4c13-abad-6c97b062ce3e None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:03.166002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7db3dd-a48e-4c13-abad-6c97b062ce3e None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:03.166289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7db3dd-a48e-4c13-abad-6c97b062ce3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:03.183503 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-ee7db3dd-a48e-4c13-abad-6c97b062ce3e None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:03.184729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-ee7db3dd-a48e-4c13-abad-6c97b062ce3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:03.191845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6389f1b9-e0f6-47e2-92e6-c257d8d23bd5 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:03.228864 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f074a-7d67-4a89-aab1-08fda7fb378c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:03.229513 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f074a-7d67-4a89-aab1-08fda7fb378c None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:03.229798 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f074a-7d67-4a89-aab1-08fda7fb378c None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:03.230078 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5f074a-7d67-4a89-aab1-08fda7fb378c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:03.256133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 44/81] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:03.257022 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7db3dd-a48e-4c13-abad-6c97b062ce3e None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:03.300219 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f074a-7d67-4a89-aab1-08fda7fb378c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:03.301763 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5f074a-7d67-4a89-aab1-08fda7fb378c None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:03.315579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:03.322961 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:03.355620 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7db3dd-a48e-4c13-abad-6c97b062ce3e None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:03.391114 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce7ac4-9782-47f9-b3c7-d0c3af06e858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:03.391794 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce7ac4-9782-47f9-b3c7-d0c3af06e858 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:03.392081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce7ac4-9782-47f9-b3c7-d0c3af06e858 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:03.392371 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edce7ac4-9782-47f9-b3c7-d0c3af06e858 None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:03.393163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce7ac4-9782-47f9-b3c7-d0c3af06e858 None admin] RBAC: Adding query filter params (name=member) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:03.393476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce7ac4-9782-47f9-b3c7-d0c3af06e858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:03.394888 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edce7ac4-9782-47f9-b3c7-d0c3af06e858 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:03.402191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 38/82] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:03.403050 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f074a-7d67-4a89-aab1-08fda7fb378c None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:03.403360 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 45/83] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:03.404181 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce7ac4-9782-47f9-b3c7-d0c3af06e858 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:03.505179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5f074a-7d67-4a89-aab1-08fda7fb378c None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:03.506237 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edce7ac4-9782-47f9-b3c7-d0c3af06e858 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:03.524474 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:03.528081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:03.538335 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236dec4-f2fb-4eb3-a055-3384f07330c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:03.539050 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678c5ed-61a3-46c8-8be7-f0838455a0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:03.539728 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236dec4-f2fb-4eb3-a055-3384f07330c4 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:03.539914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678c5ed-61a3-46c8-8be7-f0838455a0bf None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:03.540070 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236dec4-f2fb-4eb3-a055-3384f07330c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:03.540228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678c5ed-61a3-46c8-8be7-f0838455a0bf None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:03.540368 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d236dec4-f2fb-4eb3-a055-3384f07330c4 None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:03.540504 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678c5ed-61a3-46c8-8be7-f0838455a0bf None admin] PATH_INFO: `/v3/users/1a085e27599f4ca2adeff79d06f81706` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:03.541640 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236dec4-f2fb-4eb3-a055-3384f07330c4 None admin] RBAC: Authorizing `identity:get_project(project_id=5c24e2362747458280e0394abcfd13a3)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:03.541797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678c5ed-61a3-46c8-8be7-f0838455a0bf None admin] RBAC: Authorizing `identity:get_user(user_id=1a085e27599f4ca2adeff79d06f81706)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:03.543140 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d236dec4-f2fb-4eb3-a055-3384f07330c4 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:03.543242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678c5ed-61a3-46c8-8be7-f0838455a0bf None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:03.545009 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 46/84] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:03 2022] GET /identity/v3/users/1a085e27599f4ca2adeff79d06f81706 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:03.545595 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678c5ed-61a3-46c8-8be7-f0838455a0bf None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:03.550511 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 39/85] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:03 2022] GET /identity/v3/projects/5c24e2362747458280e0394abcfd13a3 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:03.551139 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236dec4-f2fb-4eb3-a055-3384f07330c4 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:03.656299 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d236dec4-f2fb-4eb3-a055-3384f07330c4 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:03.660546 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678c5ed-61a3-46c8-8be7-f0838455a0bf None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:03.691463 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8d59d-22bc-4299-a3e9-edfc652e97ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:03.692321 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8d59d-22bc-4299-a3e9-edfc652e97ba None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:03.692608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8d59d-22bc-4299-a3e9-edfc652e97ba None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:03.692912 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8d59d-22bc-4299-a3e9-edfc652e97ba None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:03.694119 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8d59d-22bc-4299-a3e9-edfc652e97ba None admin] RBAC: Authorizing `identity:get_project(project_id=5c24e2362747458280e0394abcfd13a3)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:03.695561 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed8d59d-22bc-4299-a3e9-edfc652e97ba None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:03.697559 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 40/86] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:03 2022] GET /identity/v3/projects/5c24e2362747458280e0394abcfd13a3 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:03.699170 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8d59d-22bc-4299-a3e9-edfc652e97ba None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:03.704203 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b7d2a-0685-4306-ae7f-6d35abb6dfe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:03.705167 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b7d2a-0685-4306-ae7f-6d35abb6dfe2 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:03.705490 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b7d2a-0685-4306-ae7f-6d35abb6dfe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:03.705780 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b7d2a-0685-4306-ae7f-6d35abb6dfe2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:03.707021 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b7d2a-0685-4306-ae7f-6d35abb6dfe2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:03.708848 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b7d2a-0685-4306-ae7f-6d35abb6dfe2 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:03.710601 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 47/87] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:49:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:03.711381 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b7d2a-0685-4306-ae7f-6d35abb6dfe2 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:03.766071 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:03.777243 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:03.811594 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8d59d-22bc-4299-a3e9-edfc652e97ba None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:03.820138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b7d2a-0685-4306-ae7f-6d35abb6dfe2 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:03.846686 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd256c5-ff6e-49ea-aa96-15e7f20b5f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:03.847563 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd256c5-ff6e-49ea-aa96-15e7f20b5f30 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:03.847853 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd256c5-ff6e-49ea-aa96-15e7f20b5f30 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:03.848136 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd256c5-ff6e-49ea-aa96-15e7f20b5f30 None admin] PATH_INFO: `/v3/users/1a085e27599f4ca2adeff79d06f81706` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:03.849362 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd256c5-ff6e-49ea-aa96-15e7f20b5f30 None admin] RBAC: Authorizing `identity:get_user(user_id=1a085e27599f4ca2adeff79d06f81706)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:03.850817 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd256c5-ff6e-49ea-aa96-15e7f20b5f30 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:03.852458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 41/88] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:03 2022] GET /identity/v3/users/1a085e27599f4ca2adeff79d06f81706 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:03.853263 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd256c5-ff6e-49ea-aa96-15e7f20b5f30 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:03.859477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905b3c1-52b9-4881-a138-41f2fcc52e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:03.860218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905b3c1-52b9-4881-a138-41f2fcc52e2a None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:03.860506 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905b3c1-52b9-4881-a138-41f2fcc52e2a None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:03.860818 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e905b3c1-52b9-4881-a138-41f2fcc52e2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:03.928499 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905b3c1-52b9-4881-a138-41f2fcc52e2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:03.929952 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e905b3c1-52b9-4881-a138-41f2fcc52e2a None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:03.955700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd256c5-ff6e-49ea-aa96-15e7f20b5f30 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:03.980008 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:03.989545 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:03.990847 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f591c-9c9c-4dfb-8621-c34d2b19c01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:03.993955 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f591c-9c9c-4dfb-8621-c34d2b19c01e None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:03.993955 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f591c-9c9c-4dfb-8621-c34d2b19c01e None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:03.993955 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363f591c-9c9c-4dfb-8621-c34d2b19c01e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:03.993955 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f591c-9c9c-4dfb-8621-c34d2b19c01e None admin] RBAC: Adding query filter params (role.id=9bca71f77ac24a898d3445ab3c205809, scope.project.id=5c24e2362747458280e0394abcfd13a3, user.id=ab5d7b1a37b74ac9a2830100d8a3e73f) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:03.993955 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f591c-9c9c-4dfb-8621-c34d2b19c01e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:03.994842 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363f591c-9c9c-4dfb-8621-c34d2b19c01e None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:04.000807 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 42/89] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:49:03 2022] GET /identity/v3/role_assignments?user.id=ab5d7b1a37b74ac9a2830100d8a3e73f&scope.project.id=5c24e2362747458280e0394abcfd13a3&role.id=9bca71f77ac24a898d3445ab3c205809 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:04.001612 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f591c-9c9c-4dfb-8621-c34d2b19c01e None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:04.039934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 48/90] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:04.041192 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905b3c1-52b9-4881-a138-41f2fcc52e2a None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:04.123558 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363f591c-9c9c-4dfb-8621-c34d2b19c01e None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:04.165122 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e905b3c1-52b9-4881-a138-41f2fcc52e2a None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:04.174935 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244970-a855-4ef4-99df-cf4daef54c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:04.175615 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244970-a855-4ef4-99df-cf4daef54c0b None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:04.175906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244970-a855-4ef4-99df-cf4daef54c0b None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:04.176194 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd244970-a855-4ef4-99df-cf4daef54c0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:04.177656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd244970-a855-4ef4-99df-cf4daef54c0b None admin] RBAC: Adding query filter params (role.id=669c23212b4843c8900c3d2e58fb6e0f, scope.project.id=5c24e2362747458280e0394abcfd13a3, user.id=1a085e27599f4ca2adeff79d06f81706) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:04.177656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd244970-a855-4ef4-99df-cf4daef54c0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:04.178913 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd244970-a855-4ef4-99df-cf4daef54c0b None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:04.185199 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 43/91] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:49:04 2022] GET /identity/v3/role_assignments?user.id=1a085e27599f4ca2adeff79d06f81706&scope.project.id=5c24e2362747458280e0394abcfd13a3&role.id=669c23212b4843c8900c3d2e58fb6e0f => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:04.189858 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244970-a855-4ef4-99df-cf4daef54c0b None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:04.216689 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a89e51-30b0-48a1-8a91-3d167d6afe8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:04.217917 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a89e51-30b0-48a1-8a91-3d167d6afe8c None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:04.217917 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a89e51-30b0-48a1-8a91-3d167d6afe8c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:04.217917 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a89e51-30b0-48a1-8a91-3d167d6afe8c None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:04.218658 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a89e51-30b0-48a1-8a91-3d167d6afe8c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:04.220236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a89e51-30b0-48a1-8a91-3d167d6afe8c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:04.254930 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:04.306516 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd244970-a855-4ef4-99df-cf4daef54c0b None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:04.343902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 49/92] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 12:49:04 2022] POST /identity/v3/users => generated 289 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:49:04.345323 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a89e51-30b0-48a1-8a91-3d167d6afe8c None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:04.351944 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad44bf-9840-4494-8307-caa2919ee542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:04.353103 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad44bf-9840-4494-8307-caa2919ee542 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:04.353601 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad44bf-9840-4494-8307-caa2919ee542 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:04.354084 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ad44bf-9840-4494-8307-caa2919ee542 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:04.366681 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:04.470040 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad44bf-9840-4494-8307-caa2919ee542 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:04.472532 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ad44bf-9840-4494-8307-caa2919ee542 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:04.487377 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a89e51-30b0-48a1-8a91-3d167d6afe8c None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:04.535895 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:04.537828 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df23d9-67a8-4518-b4c1-c853322bdf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:04.539279 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df23d9-67a8-4518-b4c1-c853322bdf58 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:04.539946 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df23d9-67a8-4518-b4c1-c853322bdf58 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:04.540435 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4df23d9-67a8-4518-b4c1-c853322bdf58 None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:04.542794 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df23d9-67a8-4518-b4c1-c853322bdf58 None admin] RBAC: Authorizing `identity:get_project(project_id=5c24e2362747458280e0394abcfd13a3)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:04.545062 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4df23d9-67a8-4518-b4c1-c853322bdf58 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:04.547151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 50/93] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:04 2022] GET /identity/v3/projects/5c24e2362747458280e0394abcfd13a3 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:04.553646 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df23d9-67a8-4518-b4c1-c853322bdf58 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:04.630381 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 44/94] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:04.638670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad44bf-9840-4494-8307-caa2919ee542 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:04.704676 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:04.742408 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4df23d9-67a8-4518-b4c1-c853322bdf58 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:04.786778 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664d945-fe5d-4257-b0b0-d35b02fa50e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:04.787443 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664d945-fe5d-4257-b0b0-d35b02fa50e8 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:04.787730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664d945-fe5d-4257-b0b0-d35b02fa50e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:04.788009 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0664d945-fe5d-4257-b0b0-d35b02fa50e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:04.789301 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664d945-fe5d-4257-b0b0-d35b02fa50e8 None admin] RBAC: Adding query filter params (role.id=4c8541aa8143464aa29696e1d957e9b5, scope.project.id=5c24e2362747458280e0394abcfd13a3, user.id=1a085e27599f4ca2adeff79d06f81706) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:04.789620 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664d945-fe5d-4257-b0b0-d35b02fa50e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:04.791257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0664d945-fe5d-4257-b0b0-d35b02fa50e8 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:04.798382 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 51/95] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:49:04 2022] GET /identity/v3/role_assignments?user.id=1a085e27599f4ca2adeff79d06f81706&scope.project.id=5c24e2362747458280e0394abcfd13a3&role.id=4c8541aa8143464aa29696e1d957e9b5 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:04.846920 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ad44bf-9840-4494-8307-caa2919ee542 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:04.885605 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47012a81-71f7-44ee-9bd2-d63c9d1a7fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:04.886477 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47012a81-71f7-44ee-9bd2-d63c9d1a7fcd None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:04.886762 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47012a81-71f7-44ee-9bd2-d63c9d1a7fcd None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:04.887039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47012a81-71f7-44ee-9bd2-d63c9d1a7fcd None admin] PATH_INFO: `/v3/projects/52a128b3643d41719277ec6a57f2c6cc` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:04.888325 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47012a81-71f7-44ee-9bd2-d63c9d1a7fcd None admin] RBAC: Authorizing `identity:get_project(project_id=52a128b3643d41719277ec6a57f2c6cc)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:04.890459 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47012a81-71f7-44ee-9bd2-d63c9d1a7fcd None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:04.892353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 45/96] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:04 2022] GET /identity/v3/projects/52a128b3643d41719277ec6a57f2c6cc => generated 312 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:04.898615 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664d945-fe5d-4257-b0b0-d35b02fa50e8 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:05.014462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0664d945-fe5d-4257-b0b0-d35b02fa50e8 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:05.051711 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6fe32-b84b-4c61-b014-34ea1645982c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:05.052381 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6fe32-b84b-4c61-b014-34ea1645982c None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:05.052717 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6fe32-b84b-4c61-b014-34ea1645982c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:05.053007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6fe32-b84b-4c61-b014-34ea1645982c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:05.053843 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6fe32-b84b-4c61-b014-34ea1645982c None admin] RBAC: Adding query filter params (role.id=669c23212b4843c8900c3d2e58fb6e0f, scope.project.id=52a128b3643d41719277ec6a57f2c6cc, user.id=1a085e27599f4ca2adeff79d06f81706) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:05.054159 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6fe32-b84b-4c61-b014-34ea1645982c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:05.055671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6fe32-b84b-4c61-b014-34ea1645982c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:05.062095 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 52/97] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:49:04 2022] GET /identity/v3/role_assignments?user.id=1a085e27599f4ca2adeff79d06f81706&scope.project.id=52a128b3643d41719277ec6a57f2c6cc&role.id=669c23212b4843c8900c3d2e58fb6e0f => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:06.588711 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff107f9-482a-412e-a92f-43930032d7ef None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:06.589733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff107f9-482a-412e-a92f-43930032d7ef None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:06.590217 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff107f9-482a-412e-a92f-43930032d7ef None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:06.592077 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 46/98] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:06.598010 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bd51a-5c65-4df6-adff-1be977402c2b None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:06.598850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bd51a-5c65-4df6-adff-1be977402c2b None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:06.599323 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020bd51a-5c65-4df6-adff-1be977402c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:06.621868 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-020bd51a-5c65-4df6-adff-1be977402c2b None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:06.623530 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-020bd51a-5c65-4df6-adff-1be977402c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:06.627182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:06.718670 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 53/99] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:06.754878 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff107f9-482a-412e-a92f-43930032d7ef None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:06.779358 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:06.873450 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff107f9-482a-412e-a92f-43930032d7ef None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:06.913190 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ffbdb-e6d7-41c9-adb5-7cbabd82aca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:06.914375 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ffbdb-e6d7-41c9-adb5-7cbabd82aca7 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:06.914912 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ffbdb-e6d7-41c9-adb5-7cbabd82aca7 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:06.915377 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ffbdb-e6d7-41c9-adb5-7cbabd82aca7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:06.930253 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2ffbdb-e6d7-41c9-adb5-7cbabd82aca7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:06.946701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-2d2ffbdb-e6d7-41c9-adb5-7cbabd82aca7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:49:06.946701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:06.946701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:06.946701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:06.946701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:06.946701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:06.946701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:06.946701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:06.946701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:06.946701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:06.946701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:06.946701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:06.946701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:06.946701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:06.946701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:06.946701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:06.947543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:06.947543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:06.947543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:06.947543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:06.947543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:06.947543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:06.947543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:06.947543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:06.947543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:06.947543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:06.947543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:06.947543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:06.947543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:06.947543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:06.947543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:06.947543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:06.948343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:06.948343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:06.948343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:06.948343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:06.948343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:06.948343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:06.948343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:06.948343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:06.948343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:06.948343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:06.948343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:49:06.948343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:06.950701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 47/100] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 12:49:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:06.957172 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bd51a-5c65-4df6-adff-1be977402c2b None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:07.067426 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020bd51a-5c65-4df6-adff-1be977402c2b None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:07.106313 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d70bf-6a0e-4323-b40d-bf9c7a851ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:07.107507 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d70bf-6a0e-4323-b40d-bf9c7a851ec8 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:07.107986 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d70bf-6a0e-4323-b40d-bf9c7a851ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:07.108518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d70bf-6a0e-4323-b40d-bf9c7a851ec8 None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:07.109488 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d70bf-6a0e-4323-b40d-bf9c7a851ec8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:07.110007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d70bf-6a0e-4323-b40d-bf9c7a851ec8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:07.111587 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01d70bf-6a0e-4323-b40d-bf9c7a851ec8 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:07.126838 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 54/101] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:07.127004 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ffbdb-e6d7-41c9-adb5-7cbabd82aca7 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:07.269677 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:07.295461 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ffbdb-e6d7-41c9-adb5-7cbabd82aca7 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:07.341547 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b767a-8a81-465c-b556-a254fd4b7d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:07.342425 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b767a-8a81-465c-b556-a254fd4b7d27 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:07.342765 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b767a-8a81-465c-b556-a254fd4b7d27 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:07.343061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b767a-8a81-465c-b556-a254fd4b7d27 None admin] PATH_INFO: `/v3/users/ab5d7b1a37b74ac9a2830100d8a3e73f` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:07.345421 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b767a-8a81-465c-b556-a254fd4b7d27 None admin] RBAC: Authorizing `identity:get_user(user_id=ab5d7b1a37b74ac9a2830100d8a3e73f)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:07.346906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b767a-8a81-465c-b556-a254fd4b7d27 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:07.348570 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 48/102] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:07 2022] GET /identity/v3/users/ab5d7b1a37b74ac9a2830100d8a3e73f => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:07.354586 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d70bf-6a0e-4323-b40d-bf9c7a851ec8 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:07.363019 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:07.496754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d70bf-6a0e-4323-b40d-bf9c7a851ec8 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:07.542653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102f90d-4265-4a34-abcf-3713ac7ead09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:07.543529 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102f90d-4265-4a34-abcf-3713ac7ead09 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:07.543817 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102f90d-4265-4a34-abcf-3713ac7ead09 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:07.544093 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102f90d-4265-4a34-abcf-3713ac7ead09 None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:07.545942 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102f90d-4265-4a34-abcf-3713ac7ead09 None admin] RBAC: Authorizing `identity:get_project(project_id=5c24e2362747458280e0394abcfd13a3)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:07.547409 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102f90d-4265-4a34-abcf-3713ac7ead09 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:07.549163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 55/103] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:07 2022] GET /identity/v3/projects/5c24e2362747458280e0394abcfd13a3 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:07.554904 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b767a-8a81-465c-b556-a254fd4b7d27 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:07.729169 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b767a-8a81-465c-b556-a254fd4b7d27 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:07.774534 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063d723-ff0b-4442-92c9-bf17781b9745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:07.775434 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063d723-ff0b-4442-92c9-bf17781b9745 None admin] REQUEST_METHOD: `PUT` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:07.775722 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063d723-ff0b-4442-92c9-bf17781b9745 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:07.776003 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d063d723-ff0b-4442-92c9-bf17781b9745 None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3/users/ab5d7b1a37b74ac9a2830100d8a3e73f/roles/9bca71f77ac24a898d3445ab3c205809` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:07.782128 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d063d723-ff0b-4442-92c9-bf17781b9745 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c24e2362747458280e0394abcfd13a3, user_id=ab5d7b1a37b74ac9a2830100d8a3e73f, role_id=9bca71f77ac24a898d3445ab3c205809)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:07.783634 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d063d723-ff0b-4442-92c9-bf17781b9745 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:07.866125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dea4ad-7aa9-4338-90d3-9717987125bc None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:07.866648 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dea4ad-7aa9-4338-90d3-9717987125bc None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:07.866718 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dea4ad-7aa9-4338-90d3-9717987125bc None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:07.868125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 56/104] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:49:07.874558 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370a30b-eb5f-456b-aed1-b820c9b2294f None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:07.874870 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370a30b-eb5f-456b-aed1-b820c9b2294f None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:07.875208 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0370a30b-eb5f-456b-aed1-b820c9b2294f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:07.901455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 49/105] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 12:49:07 2022] PUT /identity/v3/projects/5c24e2362747458280e0394abcfd13a3/users/ab5d7b1a37b74ac9a2830100d8a3e73f/roles/9bca71f77ac24a898d3445ab3c205809 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:49:07.911688 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-0370a30b-eb5f-456b-aed1-b820c9b2294f None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:07.913024 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-0370a30b-eb5f-456b-aed1-b820c9b2294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:07.995644 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:08.001259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 57/106] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 14 12:49:08.025318 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063d723-ff0b-4442-92c9-bf17781b9745 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:08.038167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:08.163610 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d063d723-ff0b-4442-92c9-bf17781b9745 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:08.227593 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1ef74f-a9e1-4c1c-866e-62b9d9af8c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:08.228426 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ef74f-a9e1-4c1c-866e-62b9d9af8c22 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:08.228739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ef74f-a9e1-4c1c-866e-62b9d9af8c22 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:08.229022 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1ef74f-a9e1-4c1c-866e-62b9d9af8c22 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:08.248759 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1ef74f-a9e1-4c1c-866e-62b9d9af8c22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:08.257157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-8e1ef74f-a9e1-4c1c-866e-62b9d9af8c22 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:08.257157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:08.257157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:08.257157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:08.257157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:08.257157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:08.257157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:08.257157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:08.257157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:08.257157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:08.257157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:08.257157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:08.257157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:08.257157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:08.257157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:08.257157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:08.258016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:08.258016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:08.258016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:08.258016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:08.258016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:08.258016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:08.258016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:08.258016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:08.258016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:08.258016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:08.258016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:08.258016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:08.258016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:08.258016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:08.258016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:08.258016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:08.258772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:08.258772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:08.258772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:08.258772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:08.258772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:08.258772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:08.258772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:08.258772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:08.258772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:08.258772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:08.258772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:08.258772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:08.258772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 50/107] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:08.267322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370a30b-eb5f-456b-aed1-b820c9b2294f None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:08.282476 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3cc26-9575-4976-b2a6-8b0ff4923b4a None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:08.282670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3cc26-9575-4976-b2a6-8b0ff4923b4a None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:08.282957 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab3cc26-9575-4976-b2a6-8b0ff4923b4a None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:08.284853 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 51/108] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:08.295490 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52ca22-5022-44eb-9baa-88d47770c44b None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:08.295851 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52ca22-5022-44eb-9baa-88d47770c44b None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:08.296115 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f52ca22-5022-44eb-9baa-88d47770c44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:08.326178 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-5f52ca22-5022-44eb-9baa-88d47770c44b None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:08.330002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-5f52ca22-5022-44eb-9baa-88d47770c44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:08.427996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0370a30b-eb5f-456b-aed1-b820c9b2294f None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:08.441776 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:08.447684 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 52/109] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:08.452783 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee9809-8102-45fd-b6c9-94d22c5f9035 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:08.452783 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee9809-8102-45fd-b6c9-94d22c5f9035 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:08.452783 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee9809-8102-45fd-b6c9-94d22c5f9035 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:08.452783 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 53/110] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:08.453094 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d8746-5a0c-473a-9984-0c6a26040b91 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:08.453170 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d8746-5a0c-473a-9984-0c6a26040b91 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:08.453416 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37d8746-5a0c-473a-9984-0c6a26040b91 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:08.454856 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 54/111] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:08.461155 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98bbcd-4194-4eb1-8ee5-4541619ec38c None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:08.461155 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98bbcd-4194-4eb1-8ee5-4541619ec38c None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:08.461155 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e98bbcd-4194-4eb1-8ee5-4541619ec38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:08.488805 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-4e98bbcd-4194-4eb1-8ee5-4541619ec38c None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:08.490017 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-4e98bbcd-4194-4eb1-8ee5-4541619ec38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:08.490870 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319dd648-5e7e-4a71-88c4-cb54fc3ea7ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:08.491551 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dd648-5e7e-4a71-88c4-cb54fc3ea7ef None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:08.491842 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dd648-5e7e-4a71-88c4-cb54fc3ea7ef None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:08.492181 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319dd648-5e7e-4a71-88c4-cb54fc3ea7ef None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:08.492984 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dd648-5e7e-4a71-88c4-cb54fc3ea7ef None admin] RBAC: Adding query filter params (name=member) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:08.493298 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dd648-5e7e-4a71-88c4-cb54fc3ea7ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:08.494698 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319dd648-5e7e-4a71-88c4-cb54fc3ea7ef None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:08.504688 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 58/112] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:08.506042 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338591c-d9d5-45e4-acf9-8b3448d130d8 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:08.506339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338591c-d9d5-45e4-acf9-8b3448d130d8 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:08.506626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d338591c-d9d5-45e4-acf9-8b3448d130d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:08.524506 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-d338591c-d9d5-45e4-acf9-8b3448d130d8 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:08.525984 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-d338591c-d9d5-45e4-acf9-8b3448d130d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:08.568762 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 55/113] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:08.568762 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98bbcd-4194-4eb1-8ee5-4541619ec38c None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:08.598317 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:08.614536 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 59/114] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:08.614536 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b7049-d3c3-4e4f-97a2-8a928e44aaad None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:08.614536 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b7049-d3c3-4e4f-97a2-8a928e44aaad None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:08.614536 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b7049-d3c3-4e4f-97a2-8a928e44aaad None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:08.614536 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 60/115] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:08.614536 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b7049-d3c3-4e4f-97a2-8a928e44aaad None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:08.684753 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e98bbcd-4194-4eb1-8ee5-4541619ec38c None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:08.712308 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:08.720383 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d6907-f76f-4c7c-8349-d1115beffa7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:08.721219 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d6907-f76f-4c7c-8349-d1115beffa7c None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:08.721511 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d6907-f76f-4c7c-8349-d1115beffa7c None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:08.721793 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788d6907-f76f-4c7c-8349-d1115beffa7c None admin] PATH_INFO: `/v3/domains/default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:08.724674 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d6907-f76f-4c7c-8349-d1115beffa7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:08.724674 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788d6907-f76f-4c7c-8349-d1115beffa7c None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:08.726376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 56/116] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:49:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:08.726958 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d6907-f76f-4c7c-8349-d1115beffa7c None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:08.743338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3b7049-d3c3-4e4f-97a2-8a928e44aaad None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:08.782644 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7a8550-ea5f-452c-9ede-f00bf4b5166f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:08.783520 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a8550-ea5f-452c-9ede-f00bf4b5166f None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:08.783806 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a8550-ea5f-452c-9ede-f00bf4b5166f None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:08.784518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7a8550-ea5f-452c-9ede-f00bf4b5166f None admin] PATH_INFO: `/v3/users/1a085e27599f4ca2adeff79d06f81706` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:08.785969 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a8550-ea5f-452c-9ede-f00bf4b5166f None admin] RBAC: Authorizing `identity:get_user(user_id=1a085e27599f4ca2adeff79d06f81706)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:08.787447 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7a8550-ea5f-452c-9ede-f00bf4b5166f None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:08.789289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 61/117] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:08 2022] GET /identity/v3/users/1a085e27599f4ca2adeff79d06f81706 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:08.790466 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91501025-f0ca-4e9a-a6ce-a4175f692f7e None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:08.790756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91501025-f0ca-4e9a-a6ce-a4175f692f7e None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:08.791037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91501025-f0ca-4e9a-a6ce-a4175f692f7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:08.808413 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-91501025-f0ca-4e9a-a6ce-a4175f692f7e None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:08.809667 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-91501025-f0ca-4e9a-a6ce-a4175f692f7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:08.838162 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788d6907-f76f-4c7c-8349-d1115beffa7c None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:08.866663 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:08.877363 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac15eae-52c8-4a1f-9c8d-f026aa42bbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:08.881609 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac15eae-52c8-4a1f-9c8d-f026aa42bbd9 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:08.881609 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac15eae-52c8-4a1f-9c8d-f026aa42bbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:08.881609 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac15eae-52c8-4a1f-9c8d-f026aa42bbd9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:08.881815 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 62/118] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:08.896673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91501025-f0ca-4e9a-a6ce-a4175f692f7e None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:08.897652 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac15eae-52c8-4a1f-9c8d-f026aa42bbd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:08.907564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-4ac15eae-52c8-4a1f-9c8d-f026aa42bbd9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:08.907564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:08.907564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:08.907564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:08.907564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:08.907564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:08.907564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:08.907564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:08.907564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:08.907564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:08.907564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:08.907564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:08.907564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:08.907564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:08.907564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:08.907564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:08.908670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:08.908670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:08.908670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:08.908670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:08.908670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:08.908670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:08.908670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:08.908670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:08.908670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:08.908670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:08.908670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:08.908670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:08.908670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:08.908670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:08.908670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:08.908670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:08.909497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:08.909497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:08.909497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:08.909497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:08.909497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:08.909497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:08.909497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:08.909497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:08.909497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:08.909497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:08.909497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:08.909497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:08.909497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 57/119] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:49:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:08.910182 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac15eae-52c8-4a1f-9c8d-f026aa42bbd9 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:08.988678 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:09.001370 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91501025-f0ca-4e9a-a6ce-a4175f692f7e None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:09.038686 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac15eae-52c8-4a1f-9c8d-f026aa42bbd9 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:09.039855 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525e588-48c0-4254-b9fb-c36eb31d94c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:09.040732 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525e588-48c0-4254-b9fb-c36eb31d94c8 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:09.041030 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525e588-48c0-4254-b9fb-c36eb31d94c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:09.041316 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4525e588-48c0-4254-b9fb-c36eb31d94c8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:09.051926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4525e588-48c0-4254-b9fb-c36eb31d94c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:09.059652 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-4525e588-48c0-4254-b9fb-c36eb31d94c8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:09.059652 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:09.059652 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:09.059652 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:09.059652 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:09.059652 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:09.059652 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:09.059652 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:09.059652 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:09.059652 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:09.059652 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:09.059652 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:09.059652 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:09.059652 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:09.059652 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:09.059652 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:09.060505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:09.060505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:09.060505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:09.060505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:09.060505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:09.060505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:09.060505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:09.060505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:09.060505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:09.060505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:09.060505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:09.060505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:09.060505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:09.060505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:09.060505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:09.060505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:09.061322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:09.061322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:09.061322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:09.061322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:09.061322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:09.061322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:09.061322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:09.061322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:09.061322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:09.061322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:09.061322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:09.061322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:09.061322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 63/120] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:09.062499 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525e588-48c0-4254-b9fb-c36eb31d94c8 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:09.081396 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ebbb7-5a1f-4ea3-88cf-17b208dfa168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:09.082061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ebbb7-5a1f-4ea3-88cf-17b208dfa168 None admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:09.082428 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ebbb7-5a1f-4ea3-88cf-17b208dfa168 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:09.082627 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652ebbb7-5a1f-4ea3-88cf-17b208dfa168 None admin] PATH_INFO: `/v3/projects` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:09.083597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ebbb7-5a1f-4ea3-88cf-17b208dfa168 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:09.085113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652ebbb7-5a1f-4ea3-88cf-17b208dfa168 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:09.119672 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:09.171433 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 58/121] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 12:49:08 2022] POST /identity/v3/projects => generated 302 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:49:09.172566 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ebbb7-5a1f-4ea3-88cf-17b208dfa168 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:09.173163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4525e588-48c0-4254-b9fb-c36eb31d94c8 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:09.227061 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d4595-3206-409e-bba6-fe5015dabb2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:09.228193 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d4595-3206-409e-bba6-fe5015dabb2d None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:09.228737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d4595-3206-409e-bba6-fe5015dabb2d None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:09.229254 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d4595-3206-409e-bba6-fe5015dabb2d None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:09.231057 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d4595-3206-409e-bba6-fe5015dabb2d None admin] RBAC: Authorizing `identity:get_project(project_id=5c24e2362747458280e0394abcfd13a3)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:09.232984 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d4595-3206-409e-bba6-fe5015dabb2d None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:09.235104 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 64/122] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:09 2022] GET /identity/v3/projects/5c24e2362747458280e0394abcfd13a3 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:09.241341 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d4595-3206-409e-bba6-fe5015dabb2d None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:09.324718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652ebbb7-5a1f-4ea3-88cf-17b208dfa168 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:09.336660 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:09.366107 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf40d9-080f-4589-ae07-3f5187fcf0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:09.367147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf40d9-080f-4589-ae07-3f5187fcf0ff None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:09.367751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf40d9-080f-4589-ae07-3f5187fcf0ff None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:09.368174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf40d9-080f-4589-ae07-3f5187fcf0ff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:09.386831 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cf40d9-080f-4589-ae07-3f5187fcf0ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:09.386997 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d4595-3206-409e-bba6-fe5015dabb2d None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:09.392950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-07cf40d9-080f-4589-ae07-3f5187fcf0ff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 12:49:09.392950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:09.392950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:09.392950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:09.392950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:09.392950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:09.392950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:09.392950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:09.392950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:09.392950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:09.392950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:09.392950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:09.392950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:09.392950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:09.392950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:09.392950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:09.393879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:09.393879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:09.393879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:09.393879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:09.393879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:09.393879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:09.393879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:09.393879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:09.393879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:09.393879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:09.393879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:09.393879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:09.393879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:09.393879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:09.393879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:09.393879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:09.394648 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:09.394648 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:09.394648 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:09.394648 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:09.394648 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:09.394648 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:09.394648 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:09.394648 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:09.394648 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:09.394648 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:09.394648 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 12:49:09.394648 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:09.394648 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 59/123] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:09.395495 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf40d9-080f-4589-ae07-3f5187fcf0ff None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:09.413035 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:09.440449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4ee9e-5c54-431d-960a-2c4e1b15e74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:09.441198 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4ee9e-5c54-431d-960a-2c4e1b15e74d None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:09.441486 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4ee9e-5c54-431d-960a-2c4e1b15e74d None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:09.441764 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4ee9e-5c54-431d-960a-2c4e1b15e74d None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:09.442523 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4ee9e-5c54-431d-960a-2c4e1b15e74d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:09.442835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4ee9e-5c54-431d-960a-2c4e1b15e74d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:09.444283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a4ee9e-5c54-431d-960a-2c4e1b15e74d None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:09.457278 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 65/124] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:49:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:09.458450 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4ee9e-5c54-431d-960a-2c4e1b15e74d None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:09.531038 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf40d9-080f-4589-ae07-3f5187fcf0ff None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:09.567371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ff696-e001-4c8b-9c3a-c352ef3a1494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:09.568545 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ff696-e001-4c8b-9c3a-c352ef3a1494 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:09.568674 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ff696-e001-4c8b-9c3a-c352ef3a1494 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:09.568944 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ff696-e001-4c8b-9c3a-c352ef3a1494 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:09.569758 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ff696-e001-4c8b-9c3a-c352ef3a1494 None admin] RBAC: Adding query filter params (name=member) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:09.570178 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ff696-e001-4c8b-9c3a-c352ef3a1494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:09.571669 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ff696-e001-4c8b-9c3a-c352ef3a1494 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:09.575555 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a4ee9e-5c54-431d-960a-2c4e1b15e74d None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:09.581043 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 60/125] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:09.581865 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ff696-e001-4c8b-9c3a-c352ef3a1494 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:09.625904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb0352-7019-4e75-89aa-6326d75503d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:09.626805 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb0352-7019-4e75-89aa-6326d75503d0 None admin] REQUEST_METHOD: `PUT` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:09.627147 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb0352-7019-4e75-89aa-6326d75503d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:09.627538 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affb0352-7019-4e75-89aa-6326d75503d0 None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3/users/1a085e27599f4ca2adeff79d06f81706/roles/669c23212b4843c8900c3d2e58fb6e0f` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:09.629768 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb0352-7019-4e75-89aa-6326d75503d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c24e2362747458280e0394abcfd13a3, user_id=1a085e27599f4ca2adeff79d06f81706, role_id=669c23212b4843c8900c3d2e58fb6e0f)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:09.632075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affb0352-7019-4e75-89aa-6326d75503d0 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:09.637326 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:09.741851 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 66/126] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 12:49:09 2022] PUT /identity/v3/projects/5c24e2362747458280e0394abcfd13a3/users/1a085e27599f4ca2adeff79d06f81706/roles/669c23212b4843c8900c3d2e58fb6e0f => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:49:09.744883 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb0352-7019-4e75-89aa-6326d75503d0 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:09.798254 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ff696-e001-4c8b-9c3a-c352ef3a1494 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:09.824624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:09.882080 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac6cb5-e653-4377-a92d-06fb44e3b389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:09.882772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac6cb5-e653-4377-a92d-06fb44e3b389 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:09.883067 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac6cb5-e653-4377-a92d-06fb44e3b389 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:09.883347 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac6cb5-e653-4377-a92d-06fb44e3b389 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:09.884125 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac6cb5-e653-4377-a92d-06fb44e3b389 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:09.884438 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac6cb5-e653-4377-a92d-06fb44e3b389 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:09.885913 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac6cb5-e653-4377-a92d-06fb44e3b389 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:09.908121 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 61/127] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:09.913405 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affb0352-7019-4e75-89aa-6326d75503d0 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:09.913864 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac6cb5-e653-4377-a92d-06fb44e3b389 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:09.984253 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d27aa5-7668-43bb-8249-3cecf8740008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:09.985389 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d27aa5-7668-43bb-8249-3cecf8740008 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:09.985512 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d27aa5-7668-43bb-8249-3cecf8740008 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:09.985765 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d27aa5-7668-43bb-8249-3cecf8740008 None admin] PATH_INFO: `/v3/users/1a085e27599f4ca2adeff79d06f81706` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:09.986977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d27aa5-7668-43bb-8249-3cecf8740008 None admin] RBAC: Authorizing `identity:get_user(user_id=1a085e27599f4ca2adeff79d06f81706)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:09.988583 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d27aa5-7668-43bb-8249-3cecf8740008 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:09.990276 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 67/128] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:09 2022] GET /identity/v3/users/1a085e27599f4ca2adeff79d06f81706 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:09.991184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d27aa5-7668-43bb-8249-3cecf8740008 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:10.052741 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:10.063359 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac6cb5-e653-4377-a92d-06fb44e3b389 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:10.103678 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ae822-c732-4419-b0b1-cceba4c11c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:10.104824 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ae822-c732-4419-b0b1-cceba4c11c09 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:10.105118 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ae822-c732-4419-b0b1-cceba4c11c09 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:10.105405 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563ae822-c732-4419-b0b1-cceba4c11c09 None admin] PATH_INFO: `/v3/users/1a085e27599f4ca2adeff79d06f81706` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:10.106663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ae822-c732-4419-b0b1-cceba4c11c09 None admin] RBAC: Authorizing `identity:get_user(user_id=1a085e27599f4ca2adeff79d06f81706)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:10.108150 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563ae822-c732-4419-b0b1-cceba4c11c09 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:10.110766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 62/129] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:09 2022] GET /identity/v3/users/1a085e27599f4ca2adeff79d06f81706 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:10.111387 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ae822-c732-4419-b0b1-cceba4c11c09 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:10.118561 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d27aa5-7668-43bb-8249-3cecf8740008 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:10.129002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:10.161204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e365e-978f-4a55-ae72-51a223da52ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:10.162348 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e365e-978f-4a55-ae72-51a223da52ce None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:10.162774 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e365e-978f-4a55-ae72-51a223da52ce None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:10.163152 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e365e-978f-4a55-ae72-51a223da52ce None admin] PATH_INFO: `/v3/users/6cf2d7a30f74438a859252e30ce799d4` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:10.179152 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e365e-978f-4a55-ae72-51a223da52ce None admin] RBAC: Authorizing `identity:get_user(user_id=6cf2d7a30f74438a859252e30ce799d4)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:10.184659 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e365e-978f-4a55-ae72-51a223da52ce None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:10.184659 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 68/130] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:09 2022] GET /identity/v3/users/6cf2d7a30f74438a859252e30ce799d4 => generated 289 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:10.184659 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e365e-978f-4a55-ae72-51a223da52ce None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:10.299290 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e365e-978f-4a55-ae72-51a223da52ce None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:10.316420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563ae822-c732-4419-b0b1-cceba4c11c09 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:10.343641 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcad83-5192-47d3-9546-7b7596388b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:10.345272 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcad83-5192-47d3-9546-7b7596388b69 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:10.345562 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcad83-5192-47d3-9546-7b7596388b69 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:10.345863 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcad83-5192-47d3-9546-7b7596388b69 None admin] PATH_INFO: `/v3/projects/52a128b3643d41719277ec6a57f2c6cc` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:10.347198 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcad83-5192-47d3-9546-7b7596388b69 None admin] RBAC: Authorizing `identity:get_project(project_id=52a128b3643d41719277ec6a57f2c6cc)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:10.348681 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcad83-5192-47d3-9546-7b7596388b69 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:10.353209 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 69/131] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:10 2022] GET /identity/v3/projects/52a128b3643d41719277ec6a57f2c6cc => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:10.354853 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcad83-5192-47d3-9546-7b7596388b69 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:10.394848 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ec8f4-789c-4532-8b46-dfe8780a1778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:10.395716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ec8f4-789c-4532-8b46-dfe8780a1778 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:10.395999 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ec8f4-789c-4532-8b46-dfe8780a1778 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:10.396297 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ec8f4-789c-4532-8b46-dfe8780a1778 None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:10.400357 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ec8f4-789c-4532-8b46-dfe8780a1778 None admin] RBAC: Authorizing `identity:get_project(project_id=5c24e2362747458280e0394abcfd13a3)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:10.401847 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ec8f4-789c-4532-8b46-dfe8780a1778 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:10.403572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 63/132] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:10 2022] GET /identity/v3/projects/5c24e2362747458280e0394abcfd13a3 => generated 298 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:10.406969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ec8f4-789c-4532-8b46-dfe8780a1778 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:10.420154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:10.470973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:10.566540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcad83-5192-47d3-9546-7b7596388b69 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:10.611544 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ec8f4-789c-4532-8b46-dfe8780a1778 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:10.638568 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e13a2a2-c859-4149-ad98-5c014dc1e926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:10.640797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13a2a2-c859-4149-ad98-5c014dc1e926 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:10.641300 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13a2a2-c859-4149-ad98-5c014dc1e926 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:10.641950 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e13a2a2-c859-4149-ad98-5c014dc1e926 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:10.665303 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e2115-dd12-4192-bae3-eb4c337daf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:10.666199 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e2115-dd12-4192-bae3-eb4c337daf39 None admin] REQUEST_METHOD: `PUT` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:10.666484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e2115-dd12-4192-bae3-eb4c337daf39 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:10.666763 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e2115-dd12-4192-bae3-eb4c337daf39 None admin] PATH_INFO: `/v3/projects/52a128b3643d41719277ec6a57f2c6cc/users/1a085e27599f4ca2adeff79d06f81706/roles/669c23212b4843c8900c3d2e58fb6e0f` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:10.668856 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e2115-dd12-4192-bae3-eb4c337daf39 None admin] RBAC: Authorizing `identity:create_grant(project_id=52a128b3643d41719277ec6a57f2c6cc, user_id=1a085e27599f4ca2adeff79d06f81706, role_id=669c23212b4843c8900c3d2e58fb6e0f)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:10.670384 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e2115-dd12-4192-bae3-eb4c337daf39 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:10.725456 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13a2a2-c859-4149-ad98-5c014dc1e926 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:10.726948 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e13a2a2-c859-4149-ad98-5c014dc1e926 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:10.762260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:10.781018 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 64/133] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 12:49:10 2022] PUT /identity/v3/projects/52a128b3643d41719277ec6a57f2c6cc/users/1a085e27599f4ca2adeff79d06f81706/roles/669c23212b4843c8900c3d2e58fb6e0f => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:49:10.782214 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e2115-dd12-4192-bae3-eb4c337daf39 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:10.889610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 70/134] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:10.899068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddbac6-31c4-46f8-b7d4-f337e856b648 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:10.900520 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddbac6-31c4-46f8-b7d4-f337e856b648 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:10.901152 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddbac6-31c4-46f8-b7d4-f337e856b648 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:10.906338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 71/135] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:10 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:10.911493 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddbac6-31c4-46f8-b7d4-f337e856b648 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:10.969154 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:10.979006 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e2115-dd12-4192-bae3-eb4c337daf39 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:11.015586 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e79e1-c281-45fd-8b0d-b6ccfe54523c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:11.016483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e79e1-c281-45fd-8b0d-b6ccfe54523c None admin] REQUEST_METHOD: `PUT` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:11.016800 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e79e1-c281-45fd-8b0d-b6ccfe54523c None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:11.017076 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186e79e1-c281-45fd-8b0d-b6ccfe54523c None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3/users/1a085e27599f4ca2adeff79d06f81706/roles/4c8541aa8143464aa29696e1d957e9b5` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:11.019310 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e79e1-c281-45fd-8b0d-b6ccfe54523c None admin] RBAC: Authorizing `identity:create_grant(project_id=5c24e2362747458280e0394abcfd13a3, user_id=1a085e27599f4ca2adeff79d06f81706, role_id=4c8541aa8143464aa29696e1d957e9b5)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:11.020788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186e79e1-c281-45fd-8b0d-b6ccfe54523c None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:11.042462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddbac6-31c4-46f8-b7d4-f337e856b648 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:11.081643 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e617086-40db-40c4-9091-2c00946cb802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:11.082520 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e617086-40db-40c4-9091-2c00946cb802 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:11.082862 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e617086-40db-40c4-9091-2c00946cb802 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:11.083387 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e617086-40db-40c4-9091-2c00946cb802 None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:11.084667 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e617086-40db-40c4-9091-2c00946cb802 None admin] RBAC: Authorizing `identity:get_project(project_id=5c24e2362747458280e0394abcfd13a3)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:11.086225 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e617086-40db-40c4-9091-2c00946cb802 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:11.088218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 72/136] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:10 2022] GET /identity/v3/projects/5c24e2362747458280e0394abcfd13a3 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:11.089470 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3dee3-4fae-4557-a679-c694cdbe69e9 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:11.089757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3dee3-4fae-4557-a679-c694cdbe69e9 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:11.090088 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d3dee3-4fae-4557-a679-c694cdbe69e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:11.095118 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:11.109323 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-07d3dee3-4fae-4557-a679-c694cdbe69e9 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:11.110726 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-07d3dee3-4fae-4557-a679-c694cdbe69e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:11.124048 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 65/137] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 12:49:10 2022] PUT /identity/v3/projects/5c24e2362747458280e0394abcfd13a3/users/1a085e27599f4ca2adeff79d06f81706/roles/4c8541aa8143464aa29696e1d957e9b5 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:49:11.125146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e79e1-c281-45fd-8b0d-b6ccfe54523c None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:11.266483 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 73/138] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:11.326613 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186e79e1-c281-45fd-8b0d-b6ccfe54523c None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:11.343628 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3dee3-4fae-4557-a679-c694cdbe69e9 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:11.396082 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b8cf0-5646-4428-b6c4-44a50c2c15ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:11.396918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b8cf0-5646-4428-b6c4-44a50c2c15ed None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:11.397212 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b8cf0-5646-4428-b6c4-44a50c2c15ed None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:11.397495 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b8cf0-5646-4428-b6c4-44a50c2c15ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:11.398347 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b8cf0-5646-4428-b6c4-44a50c2c15ed None admin] RBAC: Adding query filter params (role.id=c3cd9bef86d3428c8b7a2914eb37e097, scope.project.id=5c24e2362747458280e0394abcfd13a3, user.id=6cf2d7a30f74438a859252e30ce799d4) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:11.398664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b8cf0-5646-4428-b6c4-44a50c2c15ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:11.400294 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b8cf0-5646-4428-b6c4-44a50c2c15ed None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:11.415950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 66/139] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:49:11 2022] GET /identity/v3/role_assignments?user.id=6cf2d7a30f74438a859252e30ce799d4&scope.project.id=5c24e2362747458280e0394abcfd13a3&role.id=c3cd9bef86d3428c8b7a2914eb37e097 => generated 259 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:11.536669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d3dee3-4fae-4557-a679-c694cdbe69e9 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:11.576814 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:11.581791 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682e5f6-36d8-47c9-99c0-0c248d041ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:11.582606 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682e5f6-36d8-47c9-99c0-0c248d041ad7 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:11.582892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682e5f6-36d8-47c9-99c0-0c248d041ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:11.583420 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9682e5f6-36d8-47c9-99c0-0c248d041ad7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:11.597021 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9682e5f6-36d8-47c9-99c0-0c248d041ad7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:11.611339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-9682e5f6-36d8-47c9-99c0-0c248d041ad7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:49:11.611339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:11.611339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:11.611339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:11.611339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:11.611339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:11.611339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:11.611339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:11.611339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:11.611339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:11.611339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:11.611339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:11.611339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:11.611339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:11.611339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:11.611339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:11.612338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:11.612338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:11.612338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:11.612338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:11.612338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:11.612338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:11.612338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:11.612338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:11.612338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:11.612338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:11.612338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:11.612338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:11.612338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:11.612338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:11.612338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:11.612338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:11.613154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:11.613154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:11.613154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:11.613154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:11.613154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:11.613154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:11.613154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:11.613154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:11.613154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:11.613154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:11.613154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:49:11.613154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:11.614353 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 74/140] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 12:49:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:11.620628 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b8cf0-5646-4428-b6c4-44a50c2c15ed None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:11.654916 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:11.794293 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b8cf0-5646-4428-b6c4-44a50c2c15ed None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:11.837677 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637194e7-2193-4353-a65c-4e30309ddd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:11.838350 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637194e7-2193-4353-a65c-4e30309ddd47 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:11.838636 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637194e7-2193-4353-a65c-4e30309ddd47 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:11.838914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637194e7-2193-4353-a65c-4e30309ddd47 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:11.839664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637194e7-2193-4353-a65c-4e30309ddd47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:11.839976 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637194e7-2193-4353-a65c-4e30309ddd47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:11.841384 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637194e7-2193-4353-a65c-4e30309ddd47 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:11.856595 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 67/141] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:11.865751 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682e5f6-36d8-47c9-99c0-0c248d041ad7 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:11.905084 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b205ffd-d738-4152-8863-56fa144696f2 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:11.905465 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b205ffd-d738-4152-8863-56fa144696f2 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:11.905749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b205ffd-d738-4152-8863-56fa144696f2 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:11.907412 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 68/142] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:11.912205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdf628-020c-42f4-8fb1-0a4fb98899a2 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:11.912503 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdf628-020c-42f4-8fb1-0a4fb98899a2 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:11.912809 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cdf628-020c-42f4-8fb1-0a4fb98899a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:11.945705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-33cdf628-020c-42f4-8fb1-0a4fb98899a2 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:11.946916 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-33cdf628-020c-42f4-8fb1-0a4fb98899a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:12.078881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9682e5f6-36d8-47c9-99c0-0c248d041ad7 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:12.084316 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 69/143] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:12.120301 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdf628-020c-42f4-8fb1-0a4fb98899a2 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:12.133586 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:12.153585 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca82ca-1d07-4a17-947a-98d50f6506e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:12.154480 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca82ca-1d07-4a17-947a-98d50f6506e7 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:12.154767 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca82ca-1d07-4a17-947a-98d50f6506e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:12.155044 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca82ca-1d07-4a17-947a-98d50f6506e7 None admin] PATH_INFO: `/v3/users/ab5d7b1a37b74ac9a2830100d8a3e73f` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:12.158020 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca82ca-1d07-4a17-947a-98d50f6506e7 None admin] RBAC: Authorizing `identity:get_user(user_id=ab5d7b1a37b74ac9a2830100d8a3e73f)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:12.159563 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca82ca-1d07-4a17-947a-98d50f6506e7 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:12.161428 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 75/144] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:11 2022] GET /identity/v3/users/ab5d7b1a37b74ac9a2830100d8a3e73f => generated 247 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:12.166957 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca82ca-1d07-4a17-947a-98d50f6506e7 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:12.294100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cdf628-020c-42f4-8fb1-0a4fb98899a2 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:12.301640 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:12.332227 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745d456-53b5-48a0-bb0d-58a3c57147ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:12.332227 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d456-53b5-48a0-bb0d-58a3c57147ef None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:12.332227 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d456-53b5-48a0-bb0d-58a3c57147ef None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:12.332227 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745d456-53b5-48a0-bb0d-58a3c57147ef None admin] PATH_INFO: `/v3/domains/default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:12.332902 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745d456-53b5-48a0-bb0d-58a3c57147ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:12.334727 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745d456-53b5-48a0-bb0d-58a3c57147ef None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:12.340769 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 70/145] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:49:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:12.342082 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745d456-53b5-48a0-bb0d-58a3c57147ef None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:12.421895 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:12.440333 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca82ca-1d07-4a17-947a-98d50f6506e7 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:12.462737 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745d456-53b5-48a0-bb0d-58a3c57147ef None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:12.506614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486ab29a-8795-47a5-86cd-ff37d10772b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:12.507299 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ab29a-8795-47a5-86cd-ff37d10772b5 None admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:12.507587 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ab29a-8795-47a5-86cd-ff37d10772b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:12.507865 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486ab29a-8795-47a5-86cd-ff37d10772b5 None admin] PATH_INFO: `/v3/users` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:12.508604 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ab29a-8795-47a5-86cd-ff37d10772b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:12.510205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486ab29a-8795-47a5-86cd-ff37d10772b5 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:12.529261 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46651b58-9972-46c4-b2d2-cca80a941f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:12.530076 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46651b58-9972-46c4-b2d2-cca80a941f33 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:12.530429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46651b58-9972-46c4-b2d2-cca80a941f33 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:12.530713 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46651b58-9972-46c4-b2d2-cca80a941f33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:12.620477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46651b58-9972-46c4-b2d2-cca80a941f33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:12.621978 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46651b58-9972-46c4-b2d2-cca80a941f33 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:12.660045 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 71/146] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 12:49:12 2022] POST /identity/v3/users => generated 283 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:49:12.661412 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698ee6f-627d-4ac8-8580-f2545e2b21a4 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:12.661729 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698ee6f-627d-4ac8-8580-f2545e2b21a4 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:12.662503 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698ee6f-627d-4ac8-8580-f2545e2b21a4 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:12.663497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 72/147] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:12.685193 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d953e2-6714-4fbd-866b-d09d28c5bd6e None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:12.685486 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d953e2-6714-4fbd-866b-d09d28c5bd6e None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:12.693190 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d953e2-6714-4fbd-866b-d09d28c5bd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:12.694203 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:12.725842 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-64d953e2-6714-4fbd-866b-d09d28c5bd6e None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:12.727484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-64d953e2-6714-4fbd-866b-d09d28c5bd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:12.741747 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 76/148] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 12:49:12.750116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46651b58-9972-46c4-b2d2-cca80a941f33 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:12.859266 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 73/149] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:12.868702 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46651b58-9972-46c4-b2d2-cca80a941f33 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:12.924252 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f7750-97fc-419e-b355-8840e99cdf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:12.925071 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f7750-97fc-419e-b355-8840e99cdf2b None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:12.928083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f7750-97fc-419e-b355-8840e99cdf2b None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:12.928083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f7750-97fc-419e-b355-8840e99cdf2b None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:12.929618 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f7750-97fc-419e-b355-8840e99cdf2b None admin] RBAC: Authorizing `identity:get_project(project_id=5c24e2362747458280e0394abcfd13a3)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:12.931159 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f7750-97fc-419e-b355-8840e99cdf2b None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:12.933537 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 77/150] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:12 2022] GET /identity/v3/projects/5c24e2362747458280e0394abcfd13a3 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:12.939608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d953e2-6714-4fbd-866b-d09d28c5bd6e None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:12.940428 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f7750-97fc-419e-b355-8840e99cdf2b None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:12.971818 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:13.031647 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:13.075867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f7750-97fc-419e-b355-8840e99cdf2b None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:13.086906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d953e2-6714-4fbd-866b-d09d28c5bd6e None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:13.132523 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a2fe7-7a76-46f7-9188-a9fb05792e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:13.136661 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a2fe7-7a76-46f7-9188-a9fb05792e9b None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:13.136661 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a2fe7-7a76-46f7-9188-a9fb05792e9b None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:13.136661 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269a2fe7-7a76-46f7-9188-a9fb05792e9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:13.136661 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a2fe7-7a76-46f7-9188-a9fb05792e9b None admin] RBAC: Adding query filter params (role.id=9bca71f77ac24a898d3445ab3c205809, scope.project.id=5c24e2362747458280e0394abcfd13a3, user.id=ab5d7b1a37b74ac9a2830100d8a3e73f) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:13.136661 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a2fe7-7a76-46f7-9188-a9fb05792e9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:13.140505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269a2fe7-7a76-46f7-9188-a9fb05792e9b None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:13.149079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dafe3-562e-4ab1-94c8-fa62c552a5f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:13.149883 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dafe3-562e-4ab1-94c8-fa62c552a5f1 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:13.150168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dafe3-562e-4ab1-94c8-fa62c552a5f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:13.150446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44dafe3-562e-4ab1-94c8-fa62c552a5f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:13.152902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 78/151] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:49:12 2022] GET /identity/v3/role_assignments?user.id=ab5d7b1a37b74ac9a2830100d8a3e73f&scope.project.id=5c24e2362747458280e0394abcfd13a3&role.id=9bca71f77ac24a898d3445ab3c205809 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:13.165050 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44dafe3-562e-4ab1-94c8-fa62c552a5f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:13.173650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-f44dafe3-562e-4ab1-94c8-fa62c552a5f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:13.173650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:13.173650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:13.173650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:13.173650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:13.173650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:13.173650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:13.173650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:13.173650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:13.173650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:13.173650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:13.173650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:13.173650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:13.173650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:13.173650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:13.173650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:13.174597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:13.174597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:13.174597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:13.174597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:13.174597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:13.174597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:13.174597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:13.174597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:13.174597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:13.174597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:13.174597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:13.174597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:13.174597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:13.174597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:13.174597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:13.174597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:13.175371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:13.175371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:13.175371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:13.175371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:13.175371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:13.175371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:13.175371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:13.175371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:13.175371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:13.175371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:13.175371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:13.175371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:13.180065 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 74/152] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:13.181553 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a2fe7-7a76-46f7-9188-a9fb05792e9b None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:13.307777 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:13.318642 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269a2fe7-7a76-46f7-9188-a9fb05792e9b None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:13.370264 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc1611-00fb-4793-ac44-1f2a1627032c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:13.370981 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc1611-00fb-4793-ac44-1f2a1627032c None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:13.371231 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc1611-00fb-4793-ac44-1f2a1627032c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:13.371516 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fc1611-00fb-4793-ac44-1f2a1627032c None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:13.372357 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc1611-00fb-4793-ac44-1f2a1627032c None admin] RBAC: Adding query filter params (name=member) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:13.372725 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc1611-00fb-4793-ac44-1f2a1627032c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:13.374252 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fc1611-00fb-4793-ac44-1f2a1627032c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:13.388389 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 79/153] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:13.395527 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dafe3-562e-4ab1-94c8-fa62c552a5f1 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:13.510091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44dafe3-562e-4ab1-94c8-fa62c552a5f1 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:13.537010 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:13.555663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f34ab-a80c-4cb4-bcfc-d95f1f4a6386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:13.556549 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f34ab-a80c-4cb4-bcfc-d95f1f4a6386 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:13.556859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f34ab-a80c-4cb4-bcfc-d95f1f4a6386 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:13.557136 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891f34ab-a80c-4cb4-bcfc-d95f1f4a6386 None admin] PATH_INFO: `/v3/users/1a085e27599f4ca2adeff79d06f81706` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:13.558378 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f34ab-a80c-4cb4-bcfc-d95f1f4a6386 None admin] RBAC: Authorizing `identity:get_user(user_id=1a085e27599f4ca2adeff79d06f81706)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:13.559863 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891f34ab-a80c-4cb4-bcfc-d95f1f4a6386 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:13.562094 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 75/154] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:13 2022] GET /identity/v3/users/1a085e27599f4ca2adeff79d06f81706 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:13.570282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc1611-00fb-4793-ac44-1f2a1627032c None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:13.683941 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fc1611-00fb-4793-ac44-1f2a1627032c None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:13.727473 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32260131-7bb8-4819-b8e1-1b83cba8730d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:13.728148 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32260131-7bb8-4819-b8e1-1b83cba8730d None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:13.728436 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32260131-7bb8-4819-b8e1-1b83cba8730d None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:13.728747 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32260131-7bb8-4819-b8e1-1b83cba8730d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:13.757331 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:13.810076 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32260131-7bb8-4819-b8e1-1b83cba8730d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:13.811575 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32260131-7bb8-4819-b8e1-1b83cba8730d None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:13.930485 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 80/155] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:13.936354 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f34ab-a80c-4cb4-bcfc-d95f1f4a6386 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:14.076043 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891f34ab-a80c-4cb4-bcfc-d95f1f4a6386 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:14.131837 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed91f3f5-f9d0-4d5d-847a-8262f3df2eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:14.132442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91f3f5-f9d0-4d5d-847a-8262f3df2eef None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:14.132442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91f3f5-f9d0-4d5d-847a-8262f3df2eef None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:14.134469 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed91f3f5-f9d0-4d5d-847a-8262f3df2eef None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:14.134469 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91f3f5-f9d0-4d5d-847a-8262f3df2eef None admin] RBAC: Authorizing `identity:get_project(project_id=5c24e2362747458280e0394abcfd13a3)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:14.136667 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed91f3f5-f9d0-4d5d-847a-8262f3df2eef None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:14.137516 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 76/156] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:13 2022] GET /identity/v3/projects/5c24e2362747458280e0394abcfd13a3 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:14.145981 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32260131-7bb8-4819-b8e1-1b83cba8730d None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:14.211203 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:14.266034 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32260131-7bb8-4819-b8e1-1b83cba8730d None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:14.305502 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc8dc1-c9f4-4621-8e3f-b2ec177ea10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:14.306169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc8dc1-c9f4-4621-8e3f-b2ec177ea10a None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:14.306452 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc8dc1-c9f4-4621-8e3f-b2ec177ea10a None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:14.306728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc8dc1-c9f4-4621-8e3f-b2ec177ea10a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:14.307567 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc8dc1-c9f4-4621-8e3f-b2ec177ea10a None admin] RBAC: Adding query filter params (role.id=669c23212b4843c8900c3d2e58fb6e0f, scope.project.id=5c24e2362747458280e0394abcfd13a3, user.id=1a085e27599f4ca2adeff79d06f81706) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:14.307880 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc8dc1-c9f4-4621-8e3f-b2ec177ea10a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:14.309393 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc8dc1-c9f4-4621-8e3f-b2ec177ea10a None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:14.321657 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 81/157] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:49:14 2022] GET /identity/v3/role_assignments?user.id=1a085e27599f4ca2adeff79d06f81706&scope.project.id=5c24e2362747458280e0394abcfd13a3&role.id=669c23212b4843c8900c3d2e58fb6e0f => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:14.471717 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424a18b-55f2-409f-8aad-d9693e151c83 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:14.471900 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424a18b-55f2-409f-8aad-d9693e151c83 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:14.472171 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424a18b-55f2-409f-8aad-d9693e151c83 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:14.475407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 77/158] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:14.480299 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead35e2-99f5-4e1b-bd6f-f317a470f978 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:14.480585 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead35e2-99f5-4e1b-bd6f-f317a470f978 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:14.480900 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead35e2-99f5-4e1b-bd6f-f317a470f978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:14.501727 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-fead35e2-99f5-4e1b-bd6f-f317a470f978 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:14.503032 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-fead35e2-99f5-4e1b-bd6f-f317a470f978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:14.593061 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 82/159] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:14.621070 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424a18b-55f2-409f-8aad-d9693e151c83 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:14.694196 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:14.749043 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424a18b-55f2-409f-8aad-d9693e151c83 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:14.788830 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be7030-f685-44fd-8bc7-b93e538dcc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:14.789801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be7030-f685-44fd-8bc7-b93e538dcc6e None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:14.790089 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be7030-f685-44fd-8bc7-b93e538dcc6e None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:14.790366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28be7030-f685-44fd-8bc7-b93e538dcc6e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:14.804960 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28be7030-f685-44fd-8bc7-b93e538dcc6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:14.812906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-28be7030-f685-44fd-8bc7-b93e538dcc6e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:14.812906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:14.812906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:14.812906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:14.812906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:14.812906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:14.812906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:14.812906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:14.812906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:14.812906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:14.812906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:14.812906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:14.812906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:14.812906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:14.812906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:14.812906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:14.813886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:14.813886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:14.813886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:14.813886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:14.813886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:14.813886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:14.813886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:14.813886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:14.813886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:14.813886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:14.813886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:14.813886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:14.813886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:14.813886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:14.813886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:14.813886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:14.814644 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:14.814644 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:14.814644 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:14.814644 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:14.814644 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:14.814644 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:14.814644 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:14.814644 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:14.814644 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:14.814644 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:14.814644 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:14.814644 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:14.814644 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 78/160] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:14.820568 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead35e2-99f5-4e1b-bd6f-f317a470f978 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:14.885454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:14.941109 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead35e2-99f5-4e1b-bd6f-f317a470f978 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:14.976446 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd091d43-d1a3-45ee-aec6-57633573d80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:14.977157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd091d43-d1a3-45ee-aec6-57633573d80e None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:14.977440 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd091d43-d1a3-45ee-aec6-57633573d80e None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:14.977717 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd091d43-d1a3-45ee-aec6-57633573d80e None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:14.978471 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd091d43-d1a3-45ee-aec6-57633573d80e None admin] RBAC: Adding query filter params (name=member) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:14.978778 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd091d43-d1a3-45ee-aec6-57633573d80e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:14.980172 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd091d43-d1a3-45ee-aec6-57633573d80e None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:14.989673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 83/161] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:14.997734 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be7030-f685-44fd-8bc7-b93e538dcc6e None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:15.040422 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb440e0a-6afb-479c-bbb8-4fd5f65ae5e0 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:15.041095 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb440e0a-6afb-479c-bbb8-4fd5f65ae5e0 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:15.041570 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb440e0a-6afb-479c-bbb8-4fd5f65ae5e0 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:15.043408 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 84/162] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:15.048767 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920396a-282d-4933-a8c6-0c8d19d1baa2 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:15.049327 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920396a-282d-4933-a8c6-0c8d19d1baa2 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:15.049831 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9920396a-282d-4933-a8c6-0c8d19d1baa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:15.074809 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-9920396a-282d-4933-a8c6-0c8d19d1baa2 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:15.076336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-9920396a-282d-4933-a8c6-0c8d19d1baa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:15.136805 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28be7030-f685-44fd-8bc7-b93e538dcc6e None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:15.164999 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:15.206636 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 85/163] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:15.213486 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f95be-77c2-47db-a453-0cabb08da1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:15.214440 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f95be-77c2-47db-a453-0cabb08da1c4 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:15.214720 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f95be-77c2-47db-a453-0cabb08da1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:15.214993 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f95be-77c2-47db-a453-0cabb08da1c4 None admin] PATH_INFO: `/v3/users/1a085e27599f4ca2adeff79d06f81706` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:15.216317 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f95be-77c2-47db-a453-0cabb08da1c4 None admin] RBAC: Authorizing `identity:get_user(user_id=1a085e27599f4ca2adeff79d06f81706)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:15.217865 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f95be-77c2-47db-a453-0cabb08da1c4 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:15.219676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 79/164] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:14 2022] GET /identity/v3/users/1a085e27599f4ca2adeff79d06f81706 => generated 275 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:15.225219 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920396a-282d-4933-a8c6-0c8d19d1baa2 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:15.279086 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:15.282114 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f95be-77c2-47db-a453-0cabb08da1c4 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:15.364033 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9920396a-282d-4933-a8c6-0c8d19d1baa2 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:15.403964 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2b96c-0a69-4988-8e9a-a7ac01106c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:15.405261 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2b96c-0a69-4988-8e9a-a7ac01106c8d None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:15.405730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2b96c-0a69-4988-8e9a-a7ac01106c8d None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:15.406193 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2b96c-0a69-4988-8e9a-a7ac01106c8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:15.494864 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2b96c-0a69-4988-8e9a-a7ac01106c8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:15.496493 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b2b96c-0a69-4988-8e9a-a7ac01106c8d None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:15.516480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f95be-77c2-47db-a453-0cabb08da1c4 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:15.564247 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:15.585634 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff1fd80-f3b4-4c2e-ab50-42868562bd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:15.586450 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1fd80-f3b4-4c2e-ab50-42868562bd48 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:15.586736 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1fd80-f3b4-4c2e-ab50-42868562bd48 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:15.587014 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff1fd80-f3b4-4c2e-ab50-42868562bd48 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:15.609784 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff1fd80-f3b4-4c2e-ab50-42868562bd48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:15.621541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-1ff1fd80-f3b4-4c2e-ab50-42868562bd48 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:15.621541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:15.621541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:15.621541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:15.621541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:15.621541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:15.621541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:15.621541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:15.621541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:15.621541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:15.621541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:15.621541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:15.621541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:15.621541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:15.621541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:15.621541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:15.622656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:15.622656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:15.622656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:15.622656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:15.622656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:15.622656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:15.622656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:15.622656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:15.622656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:15.622656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:15.622656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:15.622656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:15.622656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:15.622656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:15.622656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:15.622656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:15.624184 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:15.624184 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:15.624184 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:15.624184 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:15.624184 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:15.624184 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:15.624184 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:15.624184 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:15.624184 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:15.624184 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:15.624184 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:15.624184 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:15.624184 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 80/165] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:49:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:49:15.624993 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa0551-d83b-495b-a00d-828b41025ac1 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:15.624993 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa0551-d83b-495b-a00d-828b41025ac1 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:15.625108 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa0551-d83b-495b-a00d-828b41025ac1 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:15.626336 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 81/166] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:15.631293 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa0551-d83b-495b-a00d-828b41025ac1 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:15.663511 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 86/167] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:15.665350 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423dea9-13fd-430d-93d0-66bad76b9485 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:15.665848 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423dea9-13fd-430d-93d0-66bad76b9485 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:15.666333 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a423dea9-13fd-430d-93d0-66bad76b9485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:15.695760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:15.700846 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-a423dea9-13fd-430d-93d0-66bad76b9485 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:15.702061 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-a423dea9-13fd-430d-93d0-66bad76b9485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:15.816668 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 87/168] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:15.816668 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423dea9-13fd-430d-93d0-66bad76b9485 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:15.834587 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa0551-d83b-495b-a00d-828b41025ac1 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:15.889231 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73502a97-1ce4-4e06-bc5c-27d7740021d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:15.890837 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73502a97-1ce4-4e06-bc5c-27d7740021d4 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:15.891369 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73502a97-1ce4-4e06-bc5c-27d7740021d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:15.891858 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73502a97-1ce4-4e06-bc5c-27d7740021d4 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:15.892862 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73502a97-1ce4-4e06-bc5c-27d7740021d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:15.893425 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73502a97-1ce4-4e06-bc5c-27d7740021d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:15.895094 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73502a97-1ce4-4e06-bc5c-27d7740021d4 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:15.918056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 82/169] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:49:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:15.920449 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73502a97-1ce4-4e06-bc5c-27d7740021d4 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:15.927629 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:15.985768 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a423dea9-13fd-430d-93d0-66bad76b9485 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:16.065351 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be4598-e925-4b1f-8db8-1ee944c99154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:16.066591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be4598-e925-4b1f-8db8-1ee944c99154 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:16.067078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be4598-e925-4b1f-8db8-1ee944c99154 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:16.067504 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be4598-e925-4b1f-8db8-1ee944c99154 None admin] PATH_INFO: `/v3/projects/52a128b3643d41719277ec6a57f2c6cc` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:16.068959 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be4598-e925-4b1f-8db8-1ee944c99154 None admin] RBAC: Authorizing `identity:get_project(project_id=52a128b3643d41719277ec6a57f2c6cc)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:16.070577 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be4598-e925-4b1f-8db8-1ee944c99154 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:16.072459 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 88/170] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:15 2022] GET /identity/v3/projects/52a128b3643d41719277ec6a57f2c6cc => generated 312 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:16.075757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be4598-e925-4b1f-8db8-1ee944c99154 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:16.084659 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73502a97-1ce4-4e06-bc5c-27d7740021d4 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:16.088761 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:16.149510 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66241216-8c91-4336-a563-3b988ea23ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:16.150319 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66241216-8c91-4336-a563-3b988ea23ab0 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:16.150587 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66241216-8c91-4336-a563-3b988ea23ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:16.150830 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66241216-8c91-4336-a563-3b988ea23ab0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:16.201127 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66241216-8c91-4336-a563-3b988ea23ab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:16.218011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-66241216-8c91-4336-a563-3b988ea23ab0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 12:49:16.218011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:16.218011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:16.218011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:16.218011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:16.218011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:16.218011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:16.218011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:16.218011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:16.218011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:16.218011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:16.218011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:16.218011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:16.218011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:16.218011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:16.218011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:16.219868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:16.219868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:16.219868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:16.219868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:16.219868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:16.219868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:16.219868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:16.219868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:16.219868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:16.219868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:16.219868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:16.219868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:16.219868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:16.219868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:16.219868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:16.219868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:16.221343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:16.221343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:16.221343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:16.221343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:16.221343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:16.221343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:16.221343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:16.221343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:16.221343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:16.221343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:16.221343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 12:49:16.221343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:16.221343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 83/171] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:16.221343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66241216-8c91-4336-a563-3b988ea23ab0 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:16.235107 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be4598-e925-4b1f-8db8-1ee944c99154 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:16.274386 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07ee8c-cc9c-4027-bd8b-4f1da9053f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:16.275271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07ee8c-cc9c-4027-bd8b-4f1da9053f61 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:16.275556 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07ee8c-cc9c-4027-bd8b-4f1da9053f61 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:16.275837 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea07ee8c-cc9c-4027-bd8b-4f1da9053f61 None admin] PATH_INFO: `/v3/users/1a085e27599f4ca2adeff79d06f81706` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:16.277298 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07ee8c-cc9c-4027-bd8b-4f1da9053f61 None admin] RBAC: Authorizing `identity:get_user(user_id=1a085e27599f4ca2adeff79d06f81706)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:16.278756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea07ee8c-cc9c-4027-bd8b-4f1da9053f61 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:16.287341 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 89/172] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:16 2022] GET /identity/v3/users/1a085e27599f4ca2adeff79d06f81706 => generated 275 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:16.289213 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07ee8c-cc9c-4027-bd8b-4f1da9053f61 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:16.306041 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:16.386571 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66241216-8c91-4336-a563-3b988ea23ab0 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:16.423622 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a39baa-97d4-420b-a5c3-af57d53b5b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:16.424622 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a39baa-97d4-420b-a5c3-af57d53b5b71 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:16.425143 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a39baa-97d4-420b-a5c3-af57d53b5b71 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:16.425642 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a39baa-97d4-420b-a5c3-af57d53b5b71 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:16.426714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a39baa-97d4-420b-a5c3-af57d53b5b71 None admin] RBAC: Adding query filter params (role.id=669c23212b4843c8900c3d2e58fb6e0f, scope.project.id=52a128b3643d41719277ec6a57f2c6cc, user.id=1a085e27599f4ca2adeff79d06f81706) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:16.427239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a39baa-97d4-420b-a5c3-af57d53b5b71 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:16.428949 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a39baa-97d4-420b-a5c3-af57d53b5b71 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:16.436036 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 84/173] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:49:16 2022] GET /identity/v3/role_assignments?user.id=1a085e27599f4ca2adeff79d06f81706&scope.project.id=52a128b3643d41719277ec6a57f2c6cc&role.id=669c23212b4843c8900c3d2e58fb6e0f => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:16.437309 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a39baa-97d4-420b-a5c3-af57d53b5b71 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:16.472386 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea07ee8c-cc9c-4027-bd8b-4f1da9053f61 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:16.491678 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:16.564671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3afbce-faff-4dca-b1dd-c811f4326acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:16.564671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3afbce-faff-4dca-b1dd-c811f4326acc None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:16.564671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3afbce-faff-4dca-b1dd-c811f4326acc None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:16.564671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3afbce-faff-4dca-b1dd-c811f4326acc None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:16.565187 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3afbce-faff-4dca-b1dd-c811f4326acc None admin] RBAC: Adding query filter params (name=reader) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:16.565187 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3afbce-faff-4dca-b1dd-c811f4326acc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:16.565187 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3afbce-faff-4dca-b1dd-c811f4326acc None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:16.585273 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 90/174] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:16.611630 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3afbce-faff-4dca-b1dd-c811f4326acc None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:16.647064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a39baa-97d4-420b-a5c3-af57d53b5b71 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:16.685887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec549cf7-c2c1-40b4-9a52-0affffb17e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:16.687418 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec549cf7-c2c1-40b4-9a52-0affffb17e52 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:16.687886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec549cf7-c2c1-40b4-9a52-0affffb17e52 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:16.688361 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec549cf7-c2c1-40b4-9a52-0affffb17e52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:16.760380 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec549cf7-c2c1-40b4-9a52-0affffb17e52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:16.762162 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec549cf7-c2c1-40b4-9a52-0affffb17e52 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:16.771724 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:16.791731 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:16.813358 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3afbce-faff-4dca-b1dd-c811f4326acc None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:16.865207 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59230ec6-41c1-4246-b548-149274ef35ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:16.866341 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59230ec6-41c1-4246-b548-149274ef35ef None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:16.866774 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59230ec6-41c1-4246-b548-149274ef35ef None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:16.867195 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59230ec6-41c1-4246-b548-149274ef35ef None admin] PATH_INFO: `/v3/users/6cf2d7a30f74438a859252e30ce799d4` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:16.868841 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59230ec6-41c1-4246-b548-149274ef35ef None admin] RBAC: Authorizing `identity:get_user(user_id=6cf2d7a30f74438a859252e30ce799d4)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:16.870484 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59230ec6-41c1-4246-b548-149274ef35ef None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:16.877280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 91/175] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:16 2022] GET /identity/v3/users/6cf2d7a30f74438a859252e30ce799d4 => generated 289 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:16.879025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7e8ee-509d-40c9-9c02-400a1f985950 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:16.879465 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7e8ee-509d-40c9-9c02-400a1f985950 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:16.879890 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d7e8ee-509d-40c9-9c02-400a1f985950 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:16.880023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 85/176] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:16.881622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 92/177] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:16.885080 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec549cf7-c2c1-40b4-9a52-0affffb17e52 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:16.890976 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21aee75-f63c-4769-a57d-721fed9fc7d4 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:16.891528 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21aee75-f63c-4769-a57d-721fed9fc7d4 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:16.892049 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21aee75-f63c-4769-a57d-721fed9fc7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:16.910469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-c21aee75-f63c-4769-a57d-721fed9fc7d4 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:16.911986 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-c21aee75-f63c-4769-a57d-721fed9fc7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:16.992565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 93/178] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:16.993796 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21aee75-f63c-4769-a57d-721fed9fc7d4 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:17.034035 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec549cf7-c2c1-40b4-9a52-0affffb17e52 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:17.073680 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:17.085142 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b957a-ae48-4ca2-9408-8f075cd640be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:17.086446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b957a-ae48-4ca2-9408-8f075cd640be None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:17.086961 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b957a-ae48-4ca2-9408-8f075cd640be None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:17.087443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b957a-ae48-4ca2-9408-8f075cd640be None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:17.089136 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b957a-ae48-4ca2-9408-8f075cd640be None admin] RBAC: Authorizing `identity:get_project(project_id=5c24e2362747458280e0394abcfd13a3)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:17.091000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b957a-ae48-4ca2-9408-8f075cd640be None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:17.093906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 86/179] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:16 2022] GET /identity/v3/projects/5c24e2362747458280e0394abcfd13a3 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:17.095187 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b957a-ae48-4ca2-9408-8f075cd640be None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:17.097752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:17.149745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21aee75-f63c-4769-a57d-721fed9fc7d4 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:17.199629 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61ba7e-f668-45d3-ae0a-2a2063f71413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:17.200808 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61ba7e-f668-45d3-ae0a-2a2063f71413 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:17.201077 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61ba7e-f668-45d3-ae0a-2a2063f71413 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:17.201351 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e61ba7e-f668-45d3-ae0a-2a2063f71413 None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:17.202911 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61ba7e-f668-45d3-ae0a-2a2063f71413 None admin] RBAC: Authorizing `identity:get_project(project_id=5c24e2362747458280e0394abcfd13a3)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:17.204823 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e61ba7e-f668-45d3-ae0a-2a2063f71413 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:17.208713 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 94/180] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:16 2022] GET /identity/v3/projects/5c24e2362747458280e0394abcfd13a3 => generated 298 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:17.209859 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61ba7e-f668-45d3-ae0a-2a2063f71413 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:17.229983 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b957a-ae48-4ca2-9408-8f075cd640be None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:17.269509 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bec1e1-fc5b-483f-b5e8-54f78fd23782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:17.270302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bec1e1-fc5b-483f-b5e8-54f78fd23782 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:17.270586 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bec1e1-fc5b-483f-b5e8-54f78fd23782 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:17.270864 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bec1e1-fc5b-483f-b5e8-54f78fd23782 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:17.281478 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bec1e1-fc5b-483f-b5e8-54f78fd23782 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:17.289153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-79bec1e1-fc5b-483f-b5e8-54f78fd23782 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:49:17.289153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:17.289153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:17.289153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:17.289153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:17.289153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:17.289153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:17.289153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:17.289153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:17.289153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:17.289153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:17.289153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:17.289153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:17.289153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:17.289153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:17.289153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:17.290209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:17.290209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:17.290209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:17.290209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:17.290209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:17.290209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:17.290209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:17.290209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:17.290209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:17.290209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:17.290209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:17.290209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:17.290209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:17.290209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:17.290209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:17.290209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:17.291195 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:17.291195 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:17.291195 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:17.291195 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:17.291195 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:17.291195 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:17.291195 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:17.291195 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:17.291195 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:17.291195 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:17.291195 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:49:17.291195 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:17.291195 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 87/181] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 12:49:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:17.292057 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bec1e1-fc5b-483f-b5e8-54f78fd23782 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:17.321010 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e61ba7e-f668-45d3-ae0a-2a2063f71413 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:17.347572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:17.355783 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5709f8a-9558-48a9-a173-ac9df4a970d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:17.358427 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5709f8a-9558-48a9-a173-ac9df4a970d5 None admin] REQUEST_METHOD: `PUT` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:17.358427 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5709f8a-9558-48a9-a173-ac9df4a970d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:17.358427 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5709f8a-9558-48a9-a173-ac9df4a970d5 None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3/users/6cf2d7a30f74438a859252e30ce799d4/roles/c3cd9bef86d3428c8b7a2914eb37e097` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:17.359315 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5709f8a-9558-48a9-a173-ac9df4a970d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c24e2362747458280e0394abcfd13a3, user_id=6cf2d7a30f74438a859252e30ce799d4, role_id=c3cd9bef86d3428c8b7a2914eb37e097)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:17.360843 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5709f8a-9558-48a9-a173-ac9df4a970d5 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:17.363078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:17.391293 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bec1e1-fc5b-483f-b5e8-54f78fd23782 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:17.423174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df333c9-e5fa-478b-b72f-a37394351568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:17.423821 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df333c9-e5fa-478b-b72f-a37394351568 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:17.424107 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df333c9-e5fa-478b-b72f-a37394351568 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:17.424386 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df333c9-e5fa-478b-b72f-a37394351568 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:17.425256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df333c9-e5fa-478b-b72f-a37394351568 None admin] RBAC: Adding query filter params (role.id=4c8541aa8143464aa29696e1d957e9b5, scope.project.id=5c24e2362747458280e0394abcfd13a3, user.id=1a085e27599f4ca2adeff79d06f81706) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:17.425564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df333c9-e5fa-478b-b72f-a37394351568 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:17.427013 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df333c9-e5fa-478b-b72f-a37394351568 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:17.432977 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 88/182] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:49:17 2022] GET /identity/v3/role_assignments?user.id=1a085e27599f4ca2adeff79d06f81706&scope.project.id=5c24e2362747458280e0394abcfd13a3&role.id=4c8541aa8143464aa29696e1d957e9b5 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:17.434209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887031ee-1edc-4154-8b56-217c926391b1 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:17.434497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887031ee-1edc-4154-8b56-217c926391b1 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:17.439084 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887031ee-1edc-4154-8b56-217c926391b1 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:17.439084 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 89/183] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:17.439084 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77bd9e-0a13-4b9b-93ee-5a8e8b5502b7 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:17.439084 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77bd9e-0a13-4b9b-93ee-5a8e8b5502b7 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:17.439084 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e77bd9e-0a13-4b9b-93ee-5a8e8b5502b7 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:17.439409 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 90/184] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:17.440147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77bd9e-0a13-4b9b-93ee-5a8e8b5502b7 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:17.478204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 95/185] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 12:49:17 2022] PUT /identity/v3/projects/5c24e2362747458280e0394abcfd13a3/users/6cf2d7a30f74438a859252e30ce799d4/roles/c3cd9bef86d3428c8b7a2914eb37e097 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:49:17.479850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328184a-3f47-4464-8dba-2a1b2d377e09 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:17.480208 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328184a-3f47-4464-8dba-2a1b2d377e09 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:17.480554 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5328184a-3f47-4464-8dba-2a1b2d377e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:17.500086 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-5328184a-3f47-4464-8dba-2a1b2d377e09 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:17.501433 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-5328184a-3f47-4464-8dba-2a1b2d377e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:17.566660 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e77bd9e-0a13-4b9b-93ee-5a8e8b5502b7 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:17.597878 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:17.601878 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 96/186] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:17.603735 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26c9d7-19e3-476e-8ec9-82c718ccef53 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:17.604288 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26c9d7-19e3-476e-8ec9-82c718ccef53 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:17.604801 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26c9d7-19e3-476e-8ec9-82c718ccef53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:17.629461 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-dc26c9d7-19e3-476e-8ec9-82c718ccef53 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:17.631161 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-dc26c9d7-19e3-476e-8ec9-82c718ccef53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:17.642282 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410e03e-c8fa-4f21-971d-625b428bc2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:17.643259 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410e03e-c8fa-4f21-971d-625b428bc2c9 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:17.643548 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410e03e-c8fa-4f21-971d-625b428bc2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:17.643825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f410e03e-c8fa-4f21-971d-625b428bc2c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:17.645466 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410e03e-c8fa-4f21-971d-625b428bc2c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:17.646021 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410e03e-c8fa-4f21-971d-625b428bc2c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:17.648424 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f410e03e-c8fa-4f21-971d-625b428bc2c9 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:17.661710 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 91/187] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:17.662011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410e03e-c8fa-4f21-971d-625b428bc2c9 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:17.738578 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 97/188] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:17.739452 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26c9d7-19e3-476e-8ec9-82c718ccef53 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:17.795033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f410e03e-c8fa-4f21-971d-625b428bc2c9 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:17.808035 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:17.833173 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bad1a-ee99-4576-8c9a-cd2dfba1be3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:17.834148 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bad1a-ee99-4576-8c9a-cd2dfba1be3a None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:17.834427 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bad1a-ee99-4576-8c9a-cd2dfba1be3a None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:17.834697 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692bad1a-ee99-4576-8c9a-cd2dfba1be3a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:17.845485 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692bad1a-ee99-4576-8c9a-cd2dfba1be3a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:17.853572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-692bad1a-ee99-4576-8c9a-cd2dfba1be3a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:17.853572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:17.853572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:17.853572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:17.853572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:17.853572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:17.853572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:17.853572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:17.853572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:17.853572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:17.853572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:17.853572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:17.853572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:17.853572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:17.853572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:17.853572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:17.854484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:17.854484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:17.854484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:17.854484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:17.854484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:17.854484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:17.854484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:17.854484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:17.854484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:17.854484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:17.854484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:17.854484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:17.854484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:17.854484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:17.854484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:17.854484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:17.855264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:17.855264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:17.855264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:17.855264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:17.855264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:17.855264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:17.855264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:17.855264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:17.855264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:17.855264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:17.855264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:17.855264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:17.855264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 92/189] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:49:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:17.855992 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bad1a-ee99-4576-8c9a-cd2dfba1be3a None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:17.860140 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26c9d7-19e3-476e-8ec9-82c718ccef53 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:17.896799 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67cd6b-0bd9-4de5-9d11-67ffa051edee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:17.897670 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67cd6b-0bd9-4de5-9d11-67ffa051edee None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:17.897957 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67cd6b-0bd9-4de5-9d11-67ffa051edee None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:17.898230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c67cd6b-0bd9-4de5-9d11-67ffa051edee None admin] PATH_INFO: `/v3/users/dfba146f0304400696181db41561d7e7` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:17.901991 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:17.914877 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67cd6b-0bd9-4de5-9d11-67ffa051edee None admin] RBAC: Authorizing `identity:get_user(user_id=dfba146f0304400696181db41561d7e7)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:17.916361 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c67cd6b-0bd9-4de5-9d11-67ffa051edee None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:17.918112 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 98/190] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:17 2022] GET /identity/v3/users/dfba146f0304400696181db41561d7e7 => generated 283 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:17.918897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67cd6b-0bd9-4de5-9d11-67ffa051edee None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:17.966716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692bad1a-ee99-4576-8c9a-cd2dfba1be3a None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:18.004779 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ced673-da1a-41f4-b9b3-809ec98172b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:18.005569 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ced673-da1a-41f4-b9b3-809ec98172b0 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:18.005878 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ced673-da1a-41f4-b9b3-809ec98172b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:18.006119 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ced673-da1a-41f4-b9b3-809ec98172b0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:18.007282 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ced673-da1a-41f4-b9b3-809ec98172b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:18.008755 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ced673-da1a-41f4-b9b3-809ec98172b0 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:18.016866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 93/191] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:49:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:18.016866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ced673-da1a-41f4-b9b3-809ec98172b0 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:18.029699 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c67cd6b-0bd9-4de5-9d11-67ffa051edee None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:18.044129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:18.065210 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9fc17-980c-4020-9da7-5308187e2d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:18.065891 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9fc17-980c-4020-9da7-5308187e2d3e None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:18.066179 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9fc17-980c-4020-9da7-5308187e2d3e None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:18.066456 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e9fc17-980c-4020-9da7-5308187e2d3e None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:18.067213 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9fc17-980c-4020-9da7-5308187e2d3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:18.067531 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9fc17-980c-4020-9da7-5308187e2d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:18.068970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e9fc17-980c-4020-9da7-5308187e2d3e None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:18.078596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 99/192] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:49:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:18.078596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9fc17-980c-4020-9da7-5308187e2d3e None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:18.131295 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ced673-da1a-41f4-b9b3-809ec98172b0 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:18.143063 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:18.170540 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac099f-25da-42c2-b909-b81df2966a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:18.171323 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac099f-25da-42c2-b909-b81df2966a4c None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:18.171654 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac099f-25da-42c2-b909-b81df2966a4c None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:18.171938 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ac099f-25da-42c2-b909-b81df2966a4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:18.191274 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e9fc17-980c-4020-9da7-5308187e2d3e None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:18.228919 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa859c-9052-4b8f-83a3-4493f425785d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:18.229587 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa859c-9052-4b8f-83a3-4493f425785d None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:18.229874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa859c-9052-4b8f-83a3-4493f425785d None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:18.230144 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baa859c-9052-4b8f-83a3-4493f425785d None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:18.230848 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa859c-9052-4b8f-83a3-4493f425785d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:18.232310 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baa859c-9052-4b8f-83a3-4493f425785d None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:18.244932 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac099f-25da-42c2-b909-b81df2966a4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:18.246413 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ac099f-25da-42c2-b909-b81df2966a4c None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:18.344943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 100/193] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 12:49:18 2022] POST /identity/v3/users => generated 297 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:49:18.345787 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa859c-9052-4b8f-83a3-4493f425785d None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:18.361029 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 94/194] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:18.362893 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac099f-25da-42c2-b909-b81df2966a4c None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:18.377030 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:18.391449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:18.490290 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ac099f-25da-42c2-b909-b81df2966a4c None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:18.497578 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baa859c-9052-4b8f-83a3-4493f425785d None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:18.531886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b519a4-316b-4fcf-b9f9-759c6af5b2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:18.533210 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b519a4-316b-4fcf-b9f9-759c6af5b2d4 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:18.533504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b519a4-316b-4fcf-b9f9-759c6af5b2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:18.533931 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b519a4-316b-4fcf-b9f9-759c6af5b2d4 None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:18.535386 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b519a4-316b-4fcf-b9f9-759c6af5b2d4 None admin] RBAC: Authorizing `identity:get_project(project_id=4939ee9d222341dca515aa1fa4cff0d1)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:18.537556 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b519a4-316b-4fcf-b9f9-759c6af5b2d4 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:18.540280 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 95/195] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:18 2022] GET /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:18.547627 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b519a4-316b-4fcf-b9f9-759c6af5b2d4 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:18.552726 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2d782-522a-4c34-aff4-2a598dcb2234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:18.553750 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2d782-522a-4c34-aff4-2a598dcb2234 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:18.554128 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2d782-522a-4c34-aff4-2a598dcb2234 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:18.554502 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2d782-522a-4c34-aff4-2a598dcb2234 None admin] PATH_INFO: `/v3/users/dfba146f0304400696181db41561d7e7` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:18.555817 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2d782-522a-4c34-aff4-2a598dcb2234 None admin] RBAC: Authorizing `identity:get_user(user_id=dfba146f0304400696181db41561d7e7)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:18.557433 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2d782-522a-4c34-aff4-2a598dcb2234 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:18.559184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 101/196] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:18 2022] GET /identity/v3/users/dfba146f0304400696181db41561d7e7 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:18.565295 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2d782-522a-4c34-aff4-2a598dcb2234 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:18.643676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:18.672908 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b519a4-316b-4fcf-b9f9-759c6af5b2d4 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:18.681147 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:18.688662 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2d782-522a-4c34-aff4-2a598dcb2234 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:18.722958 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f90ba0-fb18-4ded-95a2-836ff42615b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:18.723968 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f90ba0-fb18-4ded-95a2-836ff42615b4 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:18.724251 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f90ba0-fb18-4ded-95a2-836ff42615b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:18.724524 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f90ba0-fb18-4ded-95a2-836ff42615b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:18.725408 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f90ba0-fb18-4ded-95a2-836ff42615b4 None admin] RBAC: Adding query filter params (role.id=9bca71f77ac24a898d3445ab3c205809, scope.project.id=4939ee9d222341dca515aa1fa4cff0d1, user.id=dfba146f0304400696181db41561d7e7) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:18.725717 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f90ba0-fb18-4ded-95a2-836ff42615b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:18.727159 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f90ba0-fb18-4ded-95a2-836ff42615b4 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:18.734030 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 96/197] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:49:18 2022] GET /identity/v3/role_assignments?user.id=dfba146f0304400696181db41561d7e7&scope.project.id=4939ee9d222341dca515aa1fa4cff0d1&role.id=9bca71f77ac24a898d3445ab3c205809 => generated 259 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:18.736995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2f396-0021-4f42-88d6-8fce6cd330ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:18.737668 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2f396-0021-4f42-88d6-8fce6cd330ca None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:18.737957 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2f396-0021-4f42-88d6-8fce6cd330ca None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:18.740131 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2f396-0021-4f42-88d6-8fce6cd330ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:18.825702 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2f396-0021-4f42-88d6-8fce6cd330ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:18.827728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2f396-0021-4f42-88d6-8fce6cd330ca None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:18.944804 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 102/198] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 12:49:18.945359 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:18.950503 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f90ba0-fb18-4ded-95a2-836ff42615b4 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:19.083793 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f90ba0-fb18-4ded-95a2-836ff42615b4 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:19.119093 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92450dc-d7be-4721-b908-75f6708c950b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:19.119998 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92450dc-d7be-4721-b908-75f6708c950b None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:19.120289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92450dc-d7be-4721-b908-75f6708c950b None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:19.120567 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92450dc-d7be-4721-b908-75f6708c950b None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:19.121867 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92450dc-d7be-4721-b908-75f6708c950b None admin] RBAC: Authorizing `identity:get_project(project_id=4939ee9d222341dca515aa1fa4cff0d1)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:19.123316 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92450dc-d7be-4721-b908-75f6708c950b None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:19.125527 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 97/199] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:18 2022] GET /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:19.132937 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2f396-0021-4f42-88d6-8fce6cd330ca None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:19.280148 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2f396-0021-4f42-88d6-8fce6cd330ca None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:19.328148 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9d1ff3-0fca-4da2-a9e0-5641f7f15a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:19.328878 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d1ff3-0fca-4da2-a9e0-5641f7f15a5b None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:19.329168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d1ff3-0fca-4da2-a9e0-5641f7f15a5b None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:19.329448 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9d1ff3-0fca-4da2-a9e0-5641f7f15a5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:19.330296 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d1ff3-0fca-4da2-a9e0-5641f7f15a5b None admin] RBAC: Adding query filter params (role.id=4c8541aa8143464aa29696e1d957e9b5, scope.project.id=4939ee9d222341dca515aa1fa4cff0d1, user.id=dfba146f0304400696181db41561d7e7) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:19.330609 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d1ff3-0fca-4da2-a9e0-5641f7f15a5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:19.332170 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9d1ff3-0fca-4da2-a9e0-5641f7f15a5b None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:19.341202 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 103/200] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:49:19 2022] GET /identity/v3/role_assignments?user.id=dfba146f0304400696181db41561d7e7&scope.project.id=4939ee9d222341dca515aa1fa4cff0d1&role.id=4c8541aa8143464aa29696e1d957e9b5 => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:19.929743 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae369d9-c6b4-44c4-acfa-a9f24d48457a None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:19.930757 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae369d9-c6b4-44c4-acfa-a9f24d48457a None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:19.931242 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae369d9-c6b4-44c4-acfa-a9f24d48457a None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:19.933083 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 98/201] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:19.938870 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87d90e-e8ba-4163-a9cd-92e0fa61faad None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:19.939690 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87d90e-e8ba-4163-a9cd-92e0fa61faad None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:19.940208 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc87d90e-e8ba-4163-a9cd-92e0fa61faad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:19.958542 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-fc87d90e-e8ba-4163-a9cd-92e0fa61faad None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:19.960106 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-fc87d90e-e8ba-4163-a9cd-92e0fa61faad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:20.031038 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:20.041941 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 104/202] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:20.068173 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae369d9-c6b4-44c4-acfa-a9f24d48457a None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:20.086135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:20.222689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae369d9-c6b4-44c4-acfa-a9f24d48457a None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:20.273117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd218faa-729a-4ec4-80f4-26f962fba503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:20.274298 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd218faa-729a-4ec4-80f4-26f962fba503 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:20.274805 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd218faa-729a-4ec4-80f4-26f962fba503 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:20.275285 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd218faa-729a-4ec4-80f4-26f962fba503 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:20.290430 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd218faa-729a-4ec4-80f4-26f962fba503 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:20.298739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-cd218faa-729a-4ec4-80f4-26f962fba503 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 12:49:20.298739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:20.298739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:20.298739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:20.298739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:20.298739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:20.298739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:20.298739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:20.298739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:20.298739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:20.298739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:20.298739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:20.298739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:20.298739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:20.298739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:20.298739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:20.305247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:20.305247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:20.305247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:20.305247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:20.305247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:20.305247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:20.305247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:20.305247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:20.305247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:20.305247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:20.305247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:20.305247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:20.305247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:20.305247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:20.305247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:20.305247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:20.306041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:20.306041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:20.306041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:20.306041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:20.306041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:20.306041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:20.306041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:20.306041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:20.306041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:20.306041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:20.306041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 12:49:20.306041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:20.306642 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 99/203] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:20.314111 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87d90e-e8ba-4163-a9cd-92e0fa61faad None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:20.472291 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc87d90e-e8ba-4163-a9cd-92e0fa61faad None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:20.533334 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53481d85-5dde-4448-b81e-aedfce07d46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:20.534011 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53481d85-5dde-4448-b81e-aedfce07d46e None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:20.534294 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53481d85-5dde-4448-b81e-aedfce07d46e None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:20.534573 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53481d85-5dde-4448-b81e-aedfce07d46e None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:20.535382 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53481d85-5dde-4448-b81e-aedfce07d46e None admin] RBAC: Adding query filter params (name=reader) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:20.535689 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53481d85-5dde-4448-b81e-aedfce07d46e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:20.537113 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53481d85-5dde-4448-b81e-aedfce07d46e None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:20.545811 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 105/204] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:20.551361 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd218faa-729a-4ec4-80f4-26f962fba503 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:20.670339 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:20.719276 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd218faa-729a-4ec4-80f4-26f962fba503 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:20.763234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e00e8-2a1c-4123-a5eb-755776b9d683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:20.764089 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e00e8-2a1c-4123-a5eb-755776b9d683 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:20.764372 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e00e8-2a1c-4123-a5eb-755776b9d683 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:20.765182 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1e00e8-2a1c-4123-a5eb-755776b9d683 None admin] PATH_INFO: `/v3/users/6cf2d7a30f74438a859252e30ce799d4` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:20.766415 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e00e8-2a1c-4123-a5eb-755776b9d683 None admin] RBAC: Authorizing `identity:get_user(user_id=6cf2d7a30f74438a859252e30ce799d4)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:20.767867 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1e00e8-2a1c-4123-a5eb-755776b9d683 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:20.769690 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 100/205] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:20 2022] GET /identity/v3/users/6cf2d7a30f74438a859252e30ce799d4 => generated 289 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:20.775591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53481d85-5dde-4448-b81e-aedfce07d46e None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:20.851528 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:20.908550 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53481d85-5dde-4448-b81e-aedfce07d46e None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:20.955204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03827a59-a5b3-41e3-a4a1-a36a523cc2bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:20.955857 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03827a59-a5b3-41e3-a4a1-a36a523cc2bd None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:20.956129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03827a59-a5b3-41e3-a4a1-a36a523cc2bd None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:20.956403 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03827a59-a5b3-41e3-a4a1-a36a523cc2bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:21.041533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03827a59-a5b3-41e3-a4a1-a36a523cc2bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:21.043542 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03827a59-a5b3-41e3-a4a1-a36a523cc2bd None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:21.105718 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:21.168381 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 106/206] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:21.173933 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e00e8-2a1c-4123-a5eb-755776b9d683 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:21.314710 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1e00e8-2a1c-4123-a5eb-755776b9d683 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:21.362797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066dce0f-bc17-47ad-a9da-212bab8013df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:21.363583 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dce0f-bc17-47ad-a9da-212bab8013df None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:21.363868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dce0f-bc17-47ad-a9da-212bab8013df None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:21.364143 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066dce0f-bc17-47ad-a9da-212bab8013df None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:21.365421 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066dce0f-bc17-47ad-a9da-212bab8013df None admin] RBAC: Authorizing `identity:get_project(project_id=5c24e2362747458280e0394abcfd13a3)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:21.366928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066dce0f-bc17-47ad-a9da-212bab8013df None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:21.368735 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 101/207] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:21 2022] GET /identity/v3/projects/5c24e2362747458280e0394abcfd13a3 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:21.375005 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03827a59-a5b3-41e3-a4a1-a36a523cc2bd None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:21.438797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f5688-5145-4d73-bd8c-79b51c8ce9e3 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:21.439078 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f5688-5145-4d73-bd8c-79b51c8ce9e3 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:21.439347 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f5688-5145-4d73-bd8c-79b51c8ce9e3 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:21.440852 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 102/208] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:49:21.457798 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecaf90-6887-495e-8721-823eb687c447 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:21.458087 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecaf90-6887-495e-8721-823eb687c447 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:21.458635 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecaf90-6887-495e-8721-823eb687c447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:21.475642 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:21.488037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-9cecaf90-6887-495e-8721-823eb687c447 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:21.490718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-9cecaf90-6887-495e-8721-823eb687c447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:21.508797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03827a59-a5b3-41e3-a4a1-a36a523cc2bd None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:21.567265 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c6ffa6-408a-4877-bfbf-a18f97f3716e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:21.567933 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6ffa6-408a-4877-bfbf-a18f97f3716e None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:21.568265 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6ffa6-408a-4877-bfbf-a18f97f3716e None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:21.568545 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c6ffa6-408a-4877-bfbf-a18f97f3716e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:21.569939 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6ffa6-408a-4877-bfbf-a18f97f3716e None admin] RBAC: Adding query filter params (role.id=c3cd9bef86d3428c8b7a2914eb37e097, scope.project.id=5c24e2362747458280e0394abcfd13a3, user.id=6cf2d7a30f74438a859252e30ce799d4) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:21.569939 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6ffa6-408a-4877-bfbf-a18f97f3716e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:21.571161 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c6ffa6-408a-4877-bfbf-a18f97f3716e None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:21.583973 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 107/209] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:49:21 2022] GET /identity/v3/role_assignments?user.id=6cf2d7a30f74438a859252e30ce799d4&scope.project.id=5c24e2362747458280e0394abcfd13a3&role.id=c3cd9bef86d3428c8b7a2914eb37e097 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:21.612783 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab8c05-e6f9-4651-baa8-c1c9a5d102d4 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:21.615038 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab8c05-e6f9-4651-baa8-c1c9a5d102d4 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:21.615038 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab8c05-e6f9-4651-baa8-c1c9a5d102d4 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:21.615038 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 108/210] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:49:21.626275 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843e3db-ff18-4034-935b-c89dbd13cf88 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:21.626576 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843e3db-ff18-4034-935b-c89dbd13cf88 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:21.626672 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 103/211] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:21.626933 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8843e3db-ff18-4034-935b-c89dbd13cf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:21.639191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc046b-18be-44e5-adaf-0ecac73d12be None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:21.639491 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc046b-18be-44e5-adaf-0ecac73d12be None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:21.640279 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbc046b-18be-44e5-adaf-0ecac73d12be None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:21.641817 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 104/212] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:49:21.650415 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755048b-e00a-44e6-8860-fe8c6c4bbe60 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:21.650713 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755048b-e00a-44e6-8860-fe8c6c4bbe60 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:21.650987 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7755048b-e00a-44e6-8860-fe8c6c4bbe60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:21.658958 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-8843e3db-ff18-4034-935b-c89dbd13cf88 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:21.660630 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-8843e3db-ff18-4034-935b-c89dbd13cf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:21.671070 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-7755048b-e00a-44e6-8860-fe8c6c4bbe60 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:21.671944 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-7755048b-e00a-44e6-8860-fe8c6c4bbe60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:21.679618 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:21.755766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 105/213] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:21.756477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 109/214] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:21.764685 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755048b-e00a-44e6-8860-fe8c6c4bbe60 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:21.785099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843e3db-ff18-4034-935b-c89dbd13cf88 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:21.842483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:21.883771 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7755048b-e00a-44e6-8860-fe8c6c4bbe60 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:21.924460 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8843e3db-ff18-4034-935b-c89dbd13cf88 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:21.926274 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2217f8-55a8-4db6-9efe-520696ce8543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:21.927451 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2217f8-55a8-4db6-9efe-520696ce8543 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:21.927451 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2217f8-55a8-4db6-9efe-520696ce8543 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:21.927619 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2217f8-55a8-4db6-9efe-520696ce8543 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:21.938459 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2217f8-55a8-4db6-9efe-520696ce8543 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:21.946167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-2f2217f8-55a8-4db6-9efe-520696ce8543 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:21.946167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:21.946167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:21.946167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:21.946167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:21.946167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:21.946167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:21.946167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:21.946167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:21.946167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:21.946167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:21.946167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:21.946167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:21.946167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:21.946167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:21.946167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:21.947268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:21.947268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:21.947268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:21.947268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:21.947268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:21.947268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:21.947268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:21.947268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:21.947268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:21.947268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:21.947268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:21.947268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:21.947268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:21.947268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:21.947268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:21.947268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:21.948168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:21.948168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:21.948168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:21.948168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:21.948168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:21.948168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:21.948168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:21.948168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:21.948168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:21.948168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:21.948168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:21.948168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:21.948168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 106/215] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:21.948168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2217f8-55a8-4db6-9efe-520696ce8543 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:21.966950 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38720712-b96f-4633-8761-3f6ec82ec6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:21.968358 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38720712-b96f-4633-8761-3f6ec82ec6b2 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:21.968669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38720712-b96f-4633-8761-3f6ec82ec6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:21.968940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38720712-b96f-4633-8761-3f6ec82ec6b2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:21.979953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38720712-b96f-4633-8761-3f6ec82ec6b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:21.987839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-38720712-b96f-4633-8761-3f6ec82ec6b2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:49:21.987839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:21.987839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:21.987839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:21.987839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:21.987839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:21.987839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:21.987839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:21.987839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:21.987839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:21.987839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:21.987839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:21.987839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:21.987839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:21.987839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:21.987839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:21.988797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:21.988797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:21.988797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:21.988797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:21.988797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:21.988797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:21.988797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:21.988797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:21.988797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:21.988797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:21.988797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:21.988797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:21.988797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:21.988797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:21.988797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:21.988797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:21.989591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:21.989591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:21.989591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:21.989591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:21.989591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:21.989591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:21.989591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:21.989591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:21.989591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:21.989591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:21.989591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:49:21.989591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:21.989591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 110/216] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 12:49:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:49:21.990264 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38720712-b96f-4633-8761-3f6ec82ec6b2 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:22.003250 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:22.065659 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2217f8-55a8-4db6-9efe-520696ce8543 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:22.092246 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:22.101906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3896e7d-ae6d-42c5-9d5d-276c65efc385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:22.103807 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3896e7d-ae6d-42c5-9d5d-276c65efc385 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:22.103807 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3896e7d-ae6d-42c5-9d5d-276c65efc385 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:22.103807 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3896e7d-ae6d-42c5-9d5d-276c65efc385 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:22.104249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38720712-b96f-4633-8761-3f6ec82ec6b2 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:22.104863 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3896e7d-ae6d-42c5-9d5d-276c65efc385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:22.106322 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3896e7d-ae6d-42c5-9d5d-276c65efc385 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:22.108121 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 107/217] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:49:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:22.109303 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3896e7d-ae6d-42c5-9d5d-276c65efc385 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:22.153117 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bd0e8-d0f6-4bbe-99df-60c1c1954fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:22.153752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bd0e8-d0f6-4bbe-99df-60c1c1954fdb None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:22.153997 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bd0e8-d0f6-4bbe-99df-60c1c1954fdb None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:22.154275 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1bd0e8-d0f6-4bbe-99df-60c1c1954fdb None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:22.155037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bd0e8-d0f6-4bbe-99df-60c1c1954fdb None admin] RBAC: Adding query filter params (name=member) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:22.155450 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bd0e8-d0f6-4bbe-99df-60c1c1954fdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:22.156854 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1bd0e8-d0f6-4bbe-99df-60c1c1954fdb None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:22.165571 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 111/218] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:22.170212 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bd0e8-d0f6-4bbe-99df-60c1c1954fdb None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:22.225743 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3896e7d-ae6d-42c5-9d5d-276c65efc385 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:22.243675 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:22.264379 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce04eb-b521-4128-9db0-55db58ffe7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:22.265138 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce04eb-b521-4128-9db0-55db58ffe7f9 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:22.265428 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce04eb-b521-4128-9db0-55db58ffe7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:22.265711 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce04eb-b521-4128-9db0-55db58ffe7f9 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:22.266499 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce04eb-b521-4128-9db0-55db58ffe7f9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:22.266813 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce04eb-b521-4128-9db0-55db58ffe7f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:22.268265 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce04eb-b521-4128-9db0-55db58ffe7f9 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:22.278388 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 108/219] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:22.279105 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce04eb-b521-4128-9db0-55db58ffe7f9 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:22.281033 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1bd0e8-d0f6-4bbe-99df-60c1c1954fdb None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:22.320012 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a10879c-c9eb-4519-bfe5-c22066308e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:22.320780 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10879c-c9eb-4519-bfe5-c22066308e91 None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:22.321068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10879c-c9eb-4519-bfe5-c22066308e91 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:22.321349 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a10879c-c9eb-4519-bfe5-c22066308e91 None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:22.322068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10879c-c9eb-4519-bfe5-c22066308e91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:22.323537 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a10879c-c9eb-4519-bfe5-c22066308e91 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:22.341853 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:22.390771 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce04eb-b521-4128-9db0-55db58ffe7f9 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:22.424341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454df7d1-6b4b-4a87-874e-9acc3b86f24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:22.425185 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454df7d1-6b4b-4a87-874e-9acc3b86f24e None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:22.425522 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454df7d1-6b4b-4a87-874e-9acc3b86f24e None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:22.425815 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454df7d1-6b4b-4a87-874e-9acc3b86f24e None admin] PATH_INFO: `/v3/users/d6c33dd657f74421b2c08c9140a2a263` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:22.442308 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454df7d1-6b4b-4a87-874e-9acc3b86f24e None admin] RBAC: Authorizing `identity:get_user(user_id=d6c33dd657f74421b2c08c9140a2a263)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:22.443772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454df7d1-6b4b-4a87-874e-9acc3b86f24e None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:22.445522 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 109/220] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:22 2022] GET /identity/v3/users/d6c33dd657f74421b2c08c9140a2a263 => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:22.446300 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454df7d1-6b4b-4a87-874e-9acc3b86f24e None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:22.477786 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 112/221] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 12:49:22 2022] POST /identity/v3/users => generated 297 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:49:22.479496 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb859d33-8e34-4552-acc6-8c883b6a32a2 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:22.486427 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb859d33-8e34-4552-acc6-8c883b6a32a2 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:22.486427 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb859d33-8e34-4552-acc6-8c883b6a32a2 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:22.486427 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 113/222] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:22.486427 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb859d33-8e34-4552-acc6-8c883b6a32a2 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:22.560062 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454df7d1-6b4b-4a87-874e-9acc3b86f24e None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:22.577358 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:22.602582 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ace4a7-2a8b-425d-90f8-67d77b5e337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:22.603630 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ace4a7-2a8b-425d-90f8-67d77b5e337c None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:22.603793 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ace4a7-2a8b-425d-90f8-67d77b5e337c None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:22.604105 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ace4a7-2a8b-425d-90f8-67d77b5e337c None admin] PATH_INFO: `/v3/users/dfba146f0304400696181db41561d7e7` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:22.605372 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ace4a7-2a8b-425d-90f8-67d77b5e337c None admin] RBAC: Authorizing `identity:get_user(user_id=dfba146f0304400696181db41561d7e7)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:22.606859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ace4a7-2a8b-425d-90f8-67d77b5e337c None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:22.608344 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb859d33-8e34-4552-acc6-8c883b6a32a2 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:22.609367 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 110/223] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:22 2022] GET /identity/v3/users/dfba146f0304400696181db41561d7e7 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:22.610560 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1ded9-da36-4488-b1b8-4add5effced7 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:22.610851 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1ded9-da36-4488-b1b8-4add5effced7 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:22.611128 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1ded9-da36-4488-b1b8-4add5effced7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:22.630025 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-2ce1ded9-da36-4488-b1b8-4add5effced7 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:22.631032 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-2ce1ded9-da36-4488-b1b8-4add5effced7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:22.648328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:22.658684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5587a2-8779-405a-9c62-fe5ea435ef73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:22.659596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5587a2-8779-405a-9c62-fe5ea435ef73 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:22.659888 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5587a2-8779-405a-9c62-fe5ea435ef73 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:22.660170 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5587a2-8779-405a-9c62-fe5ea435ef73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:22.713794 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 111/224] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:22.714966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1ded9-da36-4488-b1b8-4add5effced7 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:22.751500 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5587a2-8779-405a-9c62-fe5ea435ef73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:22.753262 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5587a2-8779-405a-9c62-fe5ea435ef73 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:22.853005 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1ded9-da36-4488-b1b8-4add5effced7 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:22.872601 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:22.884859 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 114/225] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:22.885730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5587a2-8779-405a-9c62-fe5ea435ef73 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:22.899770 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7d4d3-e5a4-49ff-84d7-9100ad721522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:22.900874 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7d4d3-e5a4-49ff-84d7-9100ad721522 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:22.901200 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7d4d3-e5a4-49ff-84d7-9100ad721522 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:22.901854 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c7d4d3-e5a4-49ff-84d7-9100ad721522 None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:22.903264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7d4d3-e5a4-49ff-84d7-9100ad721522 None admin] RBAC: Authorizing `identity:get_project(project_id=4939ee9d222341dca515aa1fa4cff0d1)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:22.905362 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c7d4d3-e5a4-49ff-84d7-9100ad721522 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:22.907679 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 112/226] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:22 2022] GET /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:22.908972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7d4d3-e5a4-49ff-84d7-9100ad721522 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:22.914173 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:22.995244 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5587a2-8779-405a-9c62-fe5ea435ef73 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:23.033305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9057163-6f22-4594-a31b-6783edb8f684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:23.035008 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9057163-6f22-4594-a31b-6783edb8f684 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:23.035347 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c7d4d3-e5a4-49ff-84d7-9100ad721522 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:23.035832 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9057163-6f22-4594-a31b-6783edb8f684 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:23.036515 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9057163-6f22-4594-a31b-6783edb8f684 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:23.050493 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9057163-6f22-4594-a31b-6783edb8f684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:23.059479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-a9057163-6f22-4594-a31b-6783edb8f684 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:23.059479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:23.059479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:23.059479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:23.059479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:23.059479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:23.059479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:23.059479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:23.059479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:23.059479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:23.059479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:23.059479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:23.059479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:23.059479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:23.059479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:23.059479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:23.060374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:23.060374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:23.060374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:23.060374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:23.060374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:23.060374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:23.060374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:23.060374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:23.060374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:23.060374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:23.060374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:23.060374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:23.060374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:23.060374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:23.060374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:23.060374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:23.061578 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:23.061578 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:23.061578 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:23.061578 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:23.061578 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:23.061578 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:23.061578 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:23.061578 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:23.061578 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:23.061578 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:23.061578 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:23.061578 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:23.068841 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 115/227] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:49:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:23.069966 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9057163-6f22-4594-a31b-6783edb8f684 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:23.072812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4094a01-378f-422f-8ad2-9b1d1b691352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:23.073673 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4094a01-378f-422f-8ad2-9b1d1b691352 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:23.073952 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4094a01-378f-422f-8ad2-9b1d1b691352 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:23.074229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4094a01-378f-422f-8ad2-9b1d1b691352 None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:23.076463 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4094a01-378f-422f-8ad2-9b1d1b691352 None admin] RBAC: Authorizing `identity:get_project(project_id=4939ee9d222341dca515aa1fa4cff0d1)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:23.077991 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4094a01-378f-422f-8ad2-9b1d1b691352 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:23.080123 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 113/228] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:22 2022] GET /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:23.081005 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4094a01-378f-422f-8ad2-9b1d1b691352 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:23.144989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:23.193814 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:23.201602 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4094a01-378f-422f-8ad2-9b1d1b691352 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:23.204036 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9057163-6f22-4594-a31b-6783edb8f684 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:23.242234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81bb52-846c-4dcb-b01c-d564a324e2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:23.243695 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81bb52-846c-4dcb-b01c-d564a324e2fc None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:23.244293 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81bb52-846c-4dcb-b01c-d564a324e2fc None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:23.244805 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e81bb52-846c-4dcb-b01c-d564a324e2fc None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:23.245826 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81bb52-846c-4dcb-b01c-d564a324e2fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:23.246160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81bb52-846c-4dcb-b01c-d564a324e2fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:23.247646 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e81bb52-846c-4dcb-b01c-d564a324e2fc None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:23.249888 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4ba3b-71f8-4898-b821-cff8860de80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:23.251356 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4ba3b-71f8-4898-b821-cff8860de80c None admin] REQUEST_METHOD: `PUT` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:23.251789 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4ba3b-71f8-4898-b821-cff8860de80c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:23.252208 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4ba3b-71f8-4898-b821-cff8860de80c None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1/users/dfba146f0304400696181db41561d7e7/roles/9bca71f77ac24a898d3445ab3c205809` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:23.255280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4ba3b-71f8-4898-b821-cff8860de80c None admin] RBAC: Authorizing `identity:create_grant(project_id=4939ee9d222341dca515aa1fa4cff0d1, user_id=dfba146f0304400696181db41561d7e7, role_id=9bca71f77ac24a898d3445ab3c205809)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:23.256948 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4ba3b-71f8-4898-b821-cff8860de80c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:23.257203 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 114/229] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:49:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:23.262650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81bb52-846c-4dcb-b01c-d564a324e2fc None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:23.333599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 116/230] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 12:49:23 2022] PUT /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1/users/dfba146f0304400696181db41561d7e7/roles/9bca71f77ac24a898d3445ab3c205809 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:49:23.334599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4ba3b-71f8-4898-b821-cff8860de80c None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:23.393108 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e81bb52-846c-4dcb-b01c-d564a324e2fc None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:23.410623 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:23.447476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4ba3b-71f8-4898-b821-cff8860de80c None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:23.448841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f86800-a6a7-40c3-81ca-d8afb6fabdc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:23.451898 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f86800-a6a7-40c3-81ca-d8afb6fabdc8 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:23.452540 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f86800-a6a7-40c3-81ca-d8afb6fabdc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:23.453031 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f86800-a6a7-40c3-81ca-d8afb6fabdc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:23.454057 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f86800-a6a7-40c3-81ca-d8afb6fabdc8 None admin] RBAC: Adding query filter params (role.id=669c23212b4843c8900c3d2e58fb6e0f, scope.project.id=4939ee9d222341dca515aa1fa4cff0d1, user.id=d6c33dd657f74421b2c08c9140a2a263) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:23.454533 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f86800-a6a7-40c3-81ca-d8afb6fabdc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:23.456217 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f86800-a6a7-40c3-81ca-d8afb6fabdc8 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:23.466505 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 115/231] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:49:23 2022] GET /identity/v3/role_assignments?user.id=d6c33dd657f74421b2c08c9140a2a263&scope.project.id=4939ee9d222341dca515aa1fa4cff0d1&role.id=669c23212b4843c8900c3d2e58fb6e0f => generated 259 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:23.510565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46490f-46cd-4364-9074-2b651968f15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:23.511640 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46490f-46cd-4364-9074-2b651968f15a None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:23.512022 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46490f-46cd-4364-9074-2b651968f15a None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:23.512415 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46490f-46cd-4364-9074-2b651968f15a None admin] PATH_INFO: `/v3/users/dfba146f0304400696181db41561d7e7` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:23.517421 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46490f-46cd-4364-9074-2b651968f15a None admin] RBAC: Authorizing `identity:get_user(user_id=dfba146f0304400696181db41561d7e7)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:23.519080 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e46490f-46cd-4364-9074-2b651968f15a None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:23.521299 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 117/232] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:23 2022] GET /identity/v3/users/dfba146f0304400696181db41561d7e7 => generated 283 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:23.527049 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f86800-a6a7-40c3-81ca-d8afb6fabdc8 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:23.661098 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f86800-a6a7-40c3-81ca-d8afb6fabdc8 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:23.707179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4882364d-7bea-4faf-9a05-3b7614fb476a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:23.708566 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882364d-7bea-4faf-9a05-3b7614fb476a None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:23.709099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882364d-7bea-4faf-9a05-3b7614fb476a None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:23.709519 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4882364d-7bea-4faf-9a05-3b7614fb476a None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:23.710920 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882364d-7bea-4faf-9a05-3b7614fb476a None admin] RBAC: Authorizing `identity:get_project(project_id=4939ee9d222341dca515aa1fa4cff0d1)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:23.712581 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4882364d-7bea-4faf-9a05-3b7614fb476a None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:23.714859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 116/233] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:23 2022] GET /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:23.723253 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46490f-46cd-4364-9074-2b651968f15a None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:23.740929 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:23.833188 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46490f-46cd-4364-9074-2b651968f15a None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:23.870211 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbd9e8f-f8c1-4789-b8d3-39025aac5d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:23.871380 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd9e8f-f8c1-4789-b8d3-39025aac5d7c None admin] REQUEST_METHOD: `PUT` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:23.871818 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd9e8f-f8c1-4789-b8d3-39025aac5d7c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:23.872240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbd9e8f-f8c1-4789-b8d3-39025aac5d7c None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1/users/dfba146f0304400696181db41561d7e7/roles/4c8541aa8143464aa29696e1d957e9b5` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:23.874985 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd9e8f-f8c1-4789-b8d3-39025aac5d7c None admin] RBAC: Authorizing `identity:create_grant(project_id=4939ee9d222341dca515aa1fa4cff0d1, user_id=dfba146f0304400696181db41561d7e7, role_id=4c8541aa8143464aa29696e1d957e9b5)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:23.876750 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbd9e8f-f8c1-4789-b8d3-39025aac5d7c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:23.992809 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 118/234] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 12:49:23 2022] PUT /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1/users/dfba146f0304400696181db41561d7e7/roles/4c8541aa8143464aa29696e1d957e9b5 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:49:25.163244 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21ce8e-fe57-4143-8ffb-685abccad4f1 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:25.163783 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21ce8e-fe57-4143-8ffb-685abccad4f1 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:25.163783 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21ce8e-fe57-4143-8ffb-685abccad4f1 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:25.165201 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 117/235] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:25.170469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcedb9-49cd-4889-80ff-d99233440bc5 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:25.171425 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcedb9-49cd-4889-80ff-d99233440bc5 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:25.171538 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dcedb9-49cd-4889-80ff-d99233440bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:25.193325 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-99dcedb9-49cd-4889-80ff-d99233440bc5 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:25.194670 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-99dcedb9-49cd-4889-80ff-d99233440bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:25.205247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a67d3-385f-4ab1-87ea-31b837778eef None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:25.205538 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a67d3-385f-4ab1-87ea-31b837778eef None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:25.205826 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10a67d3-385f-4ab1-87ea-31b837778eef None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:25.207475 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 118/236] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:25.213203 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f0d43-8941-4111-9b87-b1bfb8d0daf8 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:25.213496 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f0d43-8941-4111-9b87-b1bfb8d0daf8 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:25.213777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f0d43-8941-4111-9b87-b1bfb8d0daf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:25.245566 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-329f0d43-8941-4111-9b87-b1bfb8d0daf8 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:25.246765 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-329f0d43-8941-4111-9b87-b1bfb8d0daf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:25.319246 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 119/237] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:25.338217 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:25.355935 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 119/238] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:25.372586 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcedb9-49cd-4889-80ff-d99233440bc5 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:25.376072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:25.430154 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f0d43-8941-4111-9b87-b1bfb8d0daf8 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:25.542195 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dcedb9-49cd-4889-80ff-d99233440bc5 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:25.614098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466bf57-fe24-4e9e-96ab-f25fcdc9bf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:25.614923 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466bf57-fe24-4e9e-96ab-f25fcdc9bf3f None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:25.615209 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466bf57-fe24-4e9e-96ab-f25fcdc9bf3f None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:25.615486 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466bf57-fe24-4e9e-96ab-f25fcdc9bf3f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:25.634619 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f0d43-8941-4111-9b87-b1bfb8d0daf8 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:25.637081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c466bf57-fe24-4e9e-96ab-f25fcdc9bf3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:25.652569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-c466bf57-fe24-4e9e-96ab-f25fcdc9bf3f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 12:49:25.652569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:25.652569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:25.652569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:25.652569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:25.652569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:25.652569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:25.652569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:25.652569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:25.652569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:25.652569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:25.652569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:25.652569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:25.652569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:25.652569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:25.652569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:25.653548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:25.653548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:25.653548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:25.653548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:25.653548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:25.653548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:25.653548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:25.653548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:25.653548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:25.653548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:25.653548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:25.653548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:25.653548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:25.653548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:25.653548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:25.653548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:25.654807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:25.654807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:25.654807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:25.654807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:25.654807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:25.654807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:25.654807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:25.654807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:25.654807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:25.654807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:25.654807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 12:49:25.654807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:25.654807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 120/239] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:25.662396 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466bf57-fe24-4e9e-96ab-f25fcdc9bf3f None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:25.711590 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc601608-c71a-448a-8dda-8d2d70204c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:25.712314 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc601608-c71a-448a-8dda-8d2d70204c31 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:25.712597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc601608-c71a-448a-8dda-8d2d70204c31 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:25.712899 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc601608-c71a-448a-8dda-8d2d70204c31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:25.715327 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc601608-c71a-448a-8dda-8d2d70204c31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:25.717707 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc601608-c71a-448a-8dda-8d2d70204c31 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:25.719956 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 120/240] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:49:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:25.726522 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc601608-c71a-448a-8dda-8d2d70204c31 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:25.785025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:25.819222 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:25.825715 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466bf57-fe24-4e9e-96ab-f25fcdc9bf3f None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:25.863576 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c1f7c-e74d-4f70-ae7e-73d978d3313c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:25.864351 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c1f7c-e74d-4f70-ae7e-73d978d3313c None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:25.864664 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c1f7c-e74d-4f70-ae7e-73d978d3313c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:25.864957 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806c1f7c-e74d-4f70-ae7e-73d978d3313c None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:25.865718 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c1f7c-e74d-4f70-ae7e-73d978d3313c None admin] RBAC: Adding query filter params (name=reader) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:25.866032 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c1f7c-e74d-4f70-ae7e-73d978d3313c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:25.867541 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806c1f7c-e74d-4f70-ae7e-73d978d3313c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:25.880719 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 121/241] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:25.882112 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c1f7c-e74d-4f70-ae7e-73d978d3313c None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:25.918485 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc601608-c71a-448a-8dda-8d2d70204c31 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:25.953389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ba51d-8cb9-4ba7-b0d9-97f22df9ec4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:25.954059 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ba51d-8cb9-4ba7-b0d9-97f22df9ec4a None admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:25.954338 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ba51d-8cb9-4ba7-b0d9-97f22df9ec4a None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:25.954611 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ba51d-8cb9-4ba7-b0d9-97f22df9ec4a None admin] PATH_INFO: `/v3/users` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:25.955320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ba51d-8cb9-4ba7-b0d9-97f22df9ec4a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:25.956787 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ba51d-8cb9-4ba7-b0d9-97f22df9ec4a None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:25.996817 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806c1f7c-e74d-4f70-ae7e-73d978d3313c None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:26.029025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:26.034262 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e153f3-689b-471d-9f77-e53a8b87fa05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:26.035221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e153f3-689b-471d-9f77-e53a8b87fa05 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:26.035506 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e153f3-689b-471d-9f77-e53a8b87fa05 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:26.035826 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e153f3-689b-471d-9f77-e53a8b87fa05 None admin] PATH_INFO: `/v3/users/ee1b8e1494544ecc968d3c44faf566ad` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:26.051573 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e153f3-689b-471d-9f77-e53a8b87fa05 None admin] RBAC: Authorizing `identity:get_user(user_id=ee1b8e1494544ecc968d3c44faf566ad)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:26.053148 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e153f3-689b-471d-9f77-e53a8b87fa05 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:26.055454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 122/242] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:25 2022] GET /identity/v3/users/ee1b8e1494544ecc968d3c44faf566ad => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:26.062613 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e153f3-689b-471d-9f77-e53a8b87fa05 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:26.069446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 121/243] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 12:49:25 2022] POST /identity/v3/users => generated 293 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:49:26.180090 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e153f3-689b-471d-9f77-e53a8b87fa05 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:26.218412 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab72be2-739a-44e4-8516-4c7bf67a5906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:26.219083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab72be2-739a-44e4-8516-4c7bf67a5906 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:26.219368 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab72be2-739a-44e4-8516-4c7bf67a5906 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:26.219736 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab72be2-739a-44e4-8516-4c7bf67a5906 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:26.249449 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f6000-c42c-4a0e-b5d6-ddc73abe0c3c None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:26.250760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f6000-c42c-4a0e-b5d6-ddc73abe0c3c None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:26.251554 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f6000-c42c-4a0e-b5d6-ddc73abe0c3c None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:26.253479 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 122/244] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:26.260340 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9f8ed-1c42-4e0f-8580-01c01271de5f None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:26.261229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9f8ed-1c42-4e0f-8580-01c01271de5f None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:26.261714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9f8ed-1c42-4e0f-8580-01c01271de5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:26.283561 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-a8d9f8ed-1c42-4e0f-8580-01c01271de5f None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:26.285616 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-a8d9f8ed-1c42-4e0f-8580-01c01271de5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:26.319115 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab72be2-739a-44e4-8516-4c7bf67a5906 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:26.320940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab72be2-739a-44e4-8516-4c7bf67a5906 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:26.331154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:26.400192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 123/245] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:26.420284 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33b78c-4e92-4ce8-bf93-b0be80979f4e None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:26.420863 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33b78c-4e92-4ce8-bf93-b0be80979f4e None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:26.421757 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33b78c-4e92-4ce8-bf93-b0be80979f4e None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:26.423385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 124/246] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:49:26.429790 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d98cd-acb7-4acd-9762-9221f098311f None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:26.430689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d98cd-acb7-4acd-9762-9221f098311f None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:26.431198 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69d98cd-acb7-4acd-9762-9221f098311f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:26.455293 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-d69d98cd-acb7-4acd-9762-9221f098311f None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:26.456495 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-d69d98cd-acb7-4acd-9762-9221f098311f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:26.464514 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 123/247] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 12:49:26.465734 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab72be2-739a-44e4-8516-4c7bf67a5906 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:26.482210 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:26.544373 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 125/248] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:26.547433 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d98cd-acb7-4acd-9762-9221f098311f None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:26.594024 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:26.618170 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab72be2-739a-44e4-8516-4c7bf67a5906 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:26.662663 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb44a40-9ba0-4500-bd02-720fa6f8edb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:26.663712 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb44a40-9ba0-4500-bd02-720fa6f8edb6 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:26.664136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb44a40-9ba0-4500-bd02-720fa6f8edb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:26.664578 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb44a40-9ba0-4500-bd02-720fa6f8edb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:26.674940 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69d98cd-acb7-4acd-9762-9221f098311f None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:26.681464 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb44a40-9ba0-4500-bd02-720fa6f8edb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:26.691099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-2cb44a40-9ba0-4500-bd02-720fa6f8edb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:26.691099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:26.691099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:26.691099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:26.691099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:26.691099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:26.691099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:26.691099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:26.691099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:26.691099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:26.691099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:26.691099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:26.691099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:26.691099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:26.691099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:26.691099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:26.692271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:26.692271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:26.692271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:26.692271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:26.692271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:26.692271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:26.692271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:26.692271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:26.692271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:26.692271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:26.692271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:26.692271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:26.692271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:26.692271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:26.692271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:26.692271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:26.693262 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:26.693262 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:26.693262 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:26.693262 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:26.693262 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:26.693262 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:26.693262 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:26.693262 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:26.693262 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:26.693262 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:26.693262 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:26.693262 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:26.693855 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 124/249] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:26.694655 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb44a40-9ba0-4500-bd02-720fa6f8edb6 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:26.730589 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843f9a8-f7a9-46f3-bde4-f876de33cbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:26.731843 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843f9a8-f7a9-46f3-bde4-f876de33cbad None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:26.732320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843f9a8-f7a9-46f3-bde4-f876de33cbad None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:26.732918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d843f9a8-f7a9-46f3-bde4-f876de33cbad None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:26.734830 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843f9a8-f7a9-46f3-bde4-f876de33cbad None admin] RBAC: Authorizing `identity:get_project(project_id=4939ee9d222341dca515aa1fa4cff0d1)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:26.736586 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d843f9a8-f7a9-46f3-bde4-f876de33cbad None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:26.738532 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 126/250] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:26 2022] GET /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:26.739554 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843f9a8-f7a9-46f3-bde4-f876de33cbad None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:26.767750 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:26.847495 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d843f9a8-f7a9-46f3-bde4-f876de33cbad None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:26.890417 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb44a40-9ba0-4500-bd02-720fa6f8edb6 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:26.915619 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9bbf2-79c9-46f6-a645-e38ffc59f427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:26.916745 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9bbf2-79c9-46f6-a645-e38ffc59f427 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:26.917248 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9bbf2-79c9-46f6-a645-e38ffc59f427 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:26.917722 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae9bbf2-79c9-46f6-a645-e38ffc59f427 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:26.918697 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae9bbf2-79c9-46f6-a645-e38ffc59f427 None admin] RBAC: Adding query filter params (name=member) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:26.919213 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae9bbf2-79c9-46f6-a645-e38ffc59f427 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:26.920870 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae9bbf2-79c9-46f6-a645-e38ffc59f427 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:26.931821 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 127/251] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:26.933151 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9bbf2-79c9-46f6-a645-e38ffc59f427 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:26.973447 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20bb5b-a02c-49eb-acb7-571074feb72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:26.974511 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20bb5b-a02c-49eb-acb7-571074feb72d None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:26.974939 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20bb5b-a02c-49eb-acb7-571074feb72d None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:26.975380 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20bb5b-a02c-49eb-acb7-571074feb72d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:26.992398 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20bb5b-a02c-49eb-acb7-571074feb72d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:27.003766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-0d20bb5b-a02c-49eb-acb7-571074feb72d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:49:27.003766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:27.003766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:27.003766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:27.003766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:27.003766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:27.003766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:27.003766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:27.003766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:27.003766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:27.003766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:27.003766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:27.003766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:27.003766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:27.003766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:27.003766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:27.004983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:27.004983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:27.004983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:27.004983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:27.004983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:27.004983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:27.004983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:27.004983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:27.004983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:27.004983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:27.004983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:27.004983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:27.004983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:27.004983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:27.004983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:27.004983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:27.005970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:27.005970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:27.005970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:27.005970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:27.005970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:27.005970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:27.005970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:27.005970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:27.005970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:27.005970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:27.005970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:49:27.005970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:27.014513 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 125/252] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 12:49:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:27.019841 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20bb5b-a02c-49eb-acb7-571074feb72d None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:27.025194 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:27.080757 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:27.111035 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae9bbf2-79c9-46f6-a645-e38ffc59f427 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:27.181716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2392afa-4e4a-472e-8010-5747aa44a22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:27.182475 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2392afa-4e4a-472e-8010-5747aa44a22f None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:27.182937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2392afa-4e4a-472e-8010-5747aa44a22f None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:27.183560 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2392afa-4e4a-472e-8010-5747aa44a22f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:27.185311 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2392afa-4e4a-472e-8010-5747aa44a22f None admin] RBAC: Adding query filter params (role.id=c3cd9bef86d3428c8b7a2914eb37e097, scope.project.id=4939ee9d222341dca515aa1fa4cff0d1, user.id=ee1b8e1494544ecc968d3c44faf566ad) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:27.185773 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2392afa-4e4a-472e-8010-5747aa44a22f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:27.188876 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2392afa-4e4a-472e-8010-5747aa44a22f None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:27.190819 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20bb5b-a02c-49eb-acb7-571074feb72d None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:27.196325 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 128/253] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:49:26 2022] GET /identity/v3/role_assignments?user.id=ee1b8e1494544ecc968d3c44faf566ad&scope.project.id=4939ee9d222341dca515aa1fa4cff0d1&role.id=c3cd9bef86d3428c8b7a2914eb37e097 => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:27.197283 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2392afa-4e4a-472e-8010-5747aa44a22f None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:27.232552 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829c2f9-0aa6-48f0-af72-9941c9b9f87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:27.234505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829c2f9-0aa6-48f0-af72-9941c9b9f87f None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:27.234999 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829c2f9-0aa6-48f0-af72-9941c9b9f87f None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:27.235504 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829c2f9-0aa6-48f0-af72-9941c9b9f87f None admin] PATH_INFO: `/v3/users/d6c33dd657f74421b2c08c9140a2a263` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:27.238893 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829c2f9-0aa6-48f0-af72-9941c9b9f87f None admin] RBAC: Authorizing `identity:get_user(user_id=d6c33dd657f74421b2c08c9140a2a263)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:27.240819 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829c2f9-0aa6-48f0-af72-9941c9b9f87f None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:27.243313 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 126/254] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:27 2022] GET /identity/v3/users/d6c33dd657f74421b2c08c9140a2a263 => generated 297 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:27.248144 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312f8d1-a260-418f-ac3d-94904c2e23b4 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:27.248817 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312f8d1-a260-418f-ac3d-94904c2e23b4 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:27.249338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6312f8d1-a260-418f-ac3d-94904c2e23b4 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:27.251291 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 127/255] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:27.252277 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312f8d1-a260-418f-ac3d-94904c2e23b4 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:27.364744 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2392afa-4e4a-472e-8010-5747aa44a22f None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:27.415428 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:27.449948 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0291cc-16fc-454e-a3dc-a291942b8d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:27.452283 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0291cc-16fc-454e-a3dc-a291942b8d12 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:27.452936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0291cc-16fc-454e-a3dc-a291942b8d12 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:27.454705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0291cc-16fc-454e-a3dc-a291942b8d12 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:27.455730 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0291cc-16fc-454e-a3dc-a291942b8d12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:27.460297 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0291cc-16fc-454e-a3dc-a291942b8d12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:27.462020 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0291cc-16fc-454e-a3dc-a291942b8d12 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:27.478902 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 129/256] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:27.482784 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b33830-7859-4c0c-9db8-555c415d9575 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:27.485313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b33830-7859-4c0c-9db8-555c415d9575 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:27.486415 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b33830-7859-4c0c-9db8-555c415d9575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:27.496489 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6312f8d1-a260-418f-ac3d-94904c2e23b4 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:27.515555 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-21b33830-7859-4c0c-9db8-555c415d9575 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:27.521724 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-21b33830-7859-4c0c-9db8-555c415d9575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:27.533031 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:27.585426 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a5432-8309-4ae3-8b56-959e0fe4226d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:27.586410 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a5432-8309-4ae3-8b56-959e0fe4226d None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:27.586699 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a5432-8309-4ae3-8b56-959e0fe4226d None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:27.586980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2a5432-8309-4ae3-8b56-959e0fe4226d None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:27.590968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a5432-8309-4ae3-8b56-959e0fe4226d None admin] RBAC: Authorizing `identity:get_project(project_id=4939ee9d222341dca515aa1fa4cff0d1)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:27.592460 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2a5432-8309-4ae3-8b56-959e0fe4226d None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:27.594834 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 128/257] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:27 2022] GET /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1 => generated 302 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:27.595702 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a5432-8309-4ae3-8b56-959e0fe4226d None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:27.654218 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 130/258] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:27.659747 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b33830-7859-4c0c-9db8-555c415d9575 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:27.802000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b33830-7859-4c0c-9db8-555c415d9575 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:27.844583 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584fcd1-6898-4aba-9da9-daf9da43ffbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:27.845502 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584fcd1-6898-4aba-9da9-daf9da43ffbf None admin] REQUEST_METHOD: `PUT` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:27.845788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584fcd1-6898-4aba-9da9-daf9da43ffbf None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:27.846065 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3584fcd1-6898-4aba-9da9-daf9da43ffbf None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1/users/d6c33dd657f74421b2c08c9140a2a263/roles/669c23212b4843c8900c3d2e58fb6e0f` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:27.854016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584fcd1-6898-4aba-9da9-daf9da43ffbf None admin] RBAC: Authorizing `identity:create_grant(project_id=4939ee9d222341dca515aa1fa4cff0d1, user_id=d6c33dd657f74421b2c08c9140a2a263, role_id=669c23212b4843c8900c3d2e58fb6e0f)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:27.855495 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3584fcd1-6898-4aba-9da9-daf9da43ffbf None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:27.882941 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2a5432-8309-4ae3-8b56-959e0fe4226d None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:27.940542 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 131/259] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 12:49:27 2022] PUT /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1/users/d6c33dd657f74421b2c08c9140a2a263/roles/669c23212b4843c8900c3d2e58fb6e0f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:49:27.941075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81778460-7fa6-4958-867f-677910a07bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:27.941753 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584fcd1-6898-4aba-9da9-daf9da43ffbf None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:27.942477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81778460-7fa6-4958-867f-677910a07bc1 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:27.942978 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81778460-7fa6-4958-867f-677910a07bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:27.943446 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81778460-7fa6-4958-867f-677910a07bc1 None admin] PATH_INFO: `/v3/users/dfba146f0304400696181db41561d7e7` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:27.945990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81778460-7fa6-4958-867f-677910a07bc1 None admin] RBAC: Authorizing `identity:get_user(user_id=dfba146f0304400696181db41561d7e7)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:27.947761 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81778460-7fa6-4958-867f-677910a07bc1 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:27.950039 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 129/260] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:27 2022] GET /identity/v3/users/dfba146f0304400696181db41561d7e7 => generated 283 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:27.957997 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81778460-7fa6-4958-867f-677910a07bc1 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:27.961958 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:28.001663 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:28.253241 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3584fcd1-6898-4aba-9da9-daf9da43ffbf None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:28.278414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81778460-7fa6-4958-867f-677910a07bc1 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:28.314429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfcb71-5823-4cf2-b32f-0357cdd158e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:28.315089 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfcb71-5823-4cf2-b32f-0357cdd158e0 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:28.315377 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfcb71-5823-4cf2-b32f-0357cdd158e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:28.315657 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dfcb71-5823-4cf2-b32f-0357cdd158e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:28.345374 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f48a9b-1ef0-4a4d-854b-207b6c414bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:28.346198 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f48a9b-1ef0-4a4d-854b-207b6c414bae None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:28.346487 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f48a9b-1ef0-4a4d-854b-207b6c414bae None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:28.346761 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f48a9b-1ef0-4a4d-854b-207b6c414bae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:28.376398 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f48a9b-1ef0-4a4d-854b-207b6c414bae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:28.384689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-34f48a9b-1ef0-4a4d-854b-207b6c414bae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:28.384689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:28.384689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:28.384689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:28.384689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:28.384689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:28.384689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:28.384689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:28.384689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:28.384689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:28.384689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:28.384689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:28.384689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:28.384689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:28.384689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:28.384689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:28.385580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:28.385580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:28.385580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:28.385580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:28.385580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:28.385580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:28.385580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:28.385580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:28.385580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:28.385580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:28.385580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:28.385580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:28.385580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:28.385580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:28.385580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:28.385580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:28.386483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:28.386483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:28.386483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:28.386483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:28.386483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:28.386483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:28.386483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:28.386483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:28.386483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:28.386483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:28.386483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:28.386483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:28.386483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 132/261] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:49:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 445 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:28.393725 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f48a9b-1ef0-4a4d-854b-207b6c414bae None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:28.402916 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfcb71-5823-4cf2-b32f-0357cdd158e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:28.404520 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dfcb71-5823-4cf2-b32f-0357cdd158e0 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:28.414954 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:28.515616 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 130/262] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 12:49:28.522145 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfcb71-5823-4cf2-b32f-0357cdd158e0 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:28.579137 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:28.637356 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dfcb71-5823-4cf2-b32f-0357cdd158e0 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:28.657016 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:28.697547 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b417bf-b902-479e-83bd-61c8919c7e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:28.711614 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b417bf-b902-479e-83bd-61c8919c7e86 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:28.711614 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b417bf-b902-479e-83bd-61c8919c7e86 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:28.711614 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b417bf-b902-479e-83bd-61c8919c7e86 None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:28.711614 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b417bf-b902-479e-83bd-61c8919c7e86 None admin] RBAC: Authorizing `identity:get_project(project_id=4939ee9d222341dca515aa1fa4cff0d1)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:28.711614 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b417bf-b902-479e-83bd-61c8919c7e86 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:28.711614 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 131/263] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:28 2022] GET /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:28.712347 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b417bf-b902-479e-83bd-61c8919c7e86 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:28.713312 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f48a9b-1ef0-4a4d-854b-207b6c414bae None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:28.862154 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fc59f-f112-4135-ab62-3fa6e28a2773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:28.862769 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fc59f-f112-4135-ab62-3fa6e28a2773 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:28.863053 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fc59f-f112-4135-ab62-3fa6e28a2773 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:28.863329 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211fc59f-f112-4135-ab62-3fa6e28a2773 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:28.863486 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b417bf-b902-479e-83bd-61c8919c7e86 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:28.864085 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fc59f-f112-4135-ab62-3fa6e28a2773 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:28.864392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fc59f-f112-4135-ab62-3fa6e28a2773 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:28.865885 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211fc59f-f112-4135-ab62-3fa6e28a2773 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:28.883274 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 133/264] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:49:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 490 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:28.889126 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fc59f-f112-4135-ab62-3fa6e28a2773 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:28.942616 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751d7af-78ba-407a-85d8-b128a67903ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:28.943655 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751d7af-78ba-407a-85d8-b128a67903ad None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:28.944253 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751d7af-78ba-407a-85d8-b128a67903ad None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:28.944753 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751d7af-78ba-407a-85d8-b128a67903ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:28.945879 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751d7af-78ba-407a-85d8-b128a67903ad None admin] RBAC: Adding query filter params (role.id=9bca71f77ac24a898d3445ab3c205809, scope.project.id=4939ee9d222341dca515aa1fa4cff0d1, user.id=dfba146f0304400696181db41561d7e7) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:28.946383 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751d7af-78ba-407a-85d8-b128a67903ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:28.948059 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751d7af-78ba-407a-85d8-b128a67903ad None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:28.962239 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 132/265] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:49:28 2022] GET /identity/v3/role_assignments?user.id=dfba146f0304400696181db41561d7e7&scope.project.id=4939ee9d222341dca515aa1fa4cff0d1&role.id=9bca71f77ac24a898d3445ab3c205809 => generated 608 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:29.007249 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211fc59f-f112-4135-ab62-3fa6e28a2773 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:29.032535 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:29.044010 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22cbac-2a11-43ce-8ac0-c5e45f40e683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:29.044962 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22cbac-2a11-43ce-8ac0-c5e45f40e683 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:29.045249 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22cbac-2a11-43ce-8ac0-c5e45f40e683 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:29.045528 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22cbac-2a11-43ce-8ac0-c5e45f40e683 None admin] PATH_INFO: `/v3/users/dfba146f0304400696181db41561d7e7` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:29.047405 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22cbac-2a11-43ce-8ac0-c5e45f40e683 None admin] RBAC: Authorizing `identity:get_user(user_id=dfba146f0304400696181db41561d7e7)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:29.048935 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22cbac-2a11-43ce-8ac0-c5e45f40e683 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:29.050692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 134/266] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:28 2022] GET /identity/v3/users/dfba146f0304400696181db41561d7e7 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:29.056336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751d7af-78ba-407a-85d8-b128a67903ad None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:29.137887 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:29.233273 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751d7af-78ba-407a-85d8-b128a67903ad None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:29.282440 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c6d2d-c57a-4827-81a9-7294390a068b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:29.283123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c6d2d-c57a-4827-81a9-7294390a068b None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:29.283383 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c6d2d-c57a-4827-81a9-7294390a068b None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:29.283658 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79c6d2d-c57a-4827-81a9-7294390a068b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:29.375595 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c6d2d-c57a-4827-81a9-7294390a068b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:29.377156 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79c6d2d-c57a-4827-81a9-7294390a068b None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:29.422844 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:29.441582 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f6989-6a67-4e3f-86bf-08577489bc86 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:29.442725 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f6989-6a67-4e3f-86bf-08577489bc86 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:29.443439 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591f6989-6a67-4e3f-86bf-08577489bc86 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:29.446422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 135/267] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:49:29.452889 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6246ba-1715-404e-96b3-60f81bc6deb4 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:29.453189 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6246ba-1715-404e-96b3-60f81bc6deb4 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:29.453446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6246ba-1715-404e-96b3-60f81bc6deb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:29.479704 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-ec6246ba-1715-404e-96b3-60f81bc6deb4 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:29.481254 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-ec6246ba-1715-404e-96b3-60f81bc6deb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:29.497148 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 133/268] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:29.503826 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c6d2d-c57a-4827-81a9-7294390a068b None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:29.564611 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 136/269] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:29.566247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff40a1-f1dd-4d1e-b8cd-69842c930bee None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:29.566654 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff40a1-f1dd-4d1e-b8cd-69842c930bee None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:29.567030 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff40a1-f1dd-4d1e-b8cd-69842c930bee None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:29.568392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 137/270] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:29.573646 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebb00a-5085-460c-b50a-4eacdd7fd273 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:29.574179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebb00a-5085-460c-b50a-4eacdd7fd273 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:29.574657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ebb00a-5085-460c-b50a-4eacdd7fd273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:29.598406 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-09ebb00a-5085-460c-b50a-4eacdd7fd273 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:29.600207 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-09ebb00a-5085-460c-b50a-4eacdd7fd273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:29.617834 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79c6d2d-c57a-4827-81a9-7294390a068b None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:29.659518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8068c-08c9-4b3c-8b03-1b63ce753ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:29.660648 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8068c-08c9-4b3c-8b03-1b63ce753ea3 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:29.661096 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8068c-08c9-4b3c-8b03-1b63ce753ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:29.661535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e8068c-08c9-4b3c-8b03-1b63ce753ea3 None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:29.662951 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8068c-08c9-4b3c-8b03-1b63ce753ea3 None admin] RBAC: Authorizing `identity:get_project(project_id=4939ee9d222341dca515aa1fa4cff0d1)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:29.664701 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e8068c-08c9-4b3c-8b03-1b63ce753ea3 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:29.666758 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 134/271] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:29 2022] GET /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:29.667852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8068c-08c9-4b3c-8b03-1b63ce753ea3 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:29.685367 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:29.700225 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 138/272] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:29.701664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebb00a-5085-460c-b50a-4eacdd7fd273 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:29.782395 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:29.798755 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e8068c-08c9-4b3c-8b03-1b63ce753ea3 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:29.838263 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a321141-3f85-485d-ae3f-26d37eedd74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:29.839063 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a321141-3f85-485d-ae3f-26d37eedd74b None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:29.839348 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a321141-3f85-485d-ae3f-26d37eedd74b None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:29.839622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a321141-3f85-485d-ae3f-26d37eedd74b None admin] PATH_INFO: `/v3/domains/default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:29.840931 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a321141-3f85-485d-ae3f-26d37eedd74b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:29.842522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a321141-3f85-485d-ae3f-26d37eedd74b None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:29.844518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 135/273] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:49:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:29.845297 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ebb00a-5085-460c-b50a-4eacdd7fd273 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:29.849776 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a321141-3f85-485d-ae3f-26d37eedd74b None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:29.895990 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f81e3-cb89-47f9-969b-fd3c2d4dfe7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:29.897498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f81e3-cb89-47f9-969b-fd3c2d4dfe7c None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:29.898433 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f81e3-cb89-47f9-969b-fd3c2d4dfe7c None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:29.899057 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f81e3-cb89-47f9-969b-fd3c2d4dfe7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:29.900165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f81e3-cb89-47f9-969b-fd3c2d4dfe7c None admin] RBAC: Adding query filter params (role.id=4c8541aa8143464aa29696e1d957e9b5, scope.project.id=4939ee9d222341dca515aa1fa4cff0d1, user.id=dfba146f0304400696181db41561d7e7) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:29.900911 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f81e3-cb89-47f9-969b-fd3c2d4dfe7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:29.903335 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f81e3-cb89-47f9-969b-fd3c2d4dfe7c None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:29.911266 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 139/274] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:49:29 2022] GET /identity/v3/role_assignments?user.id=dfba146f0304400696181db41561d7e7&scope.project.id=4939ee9d222341dca515aa1fa4cff0d1&role.id=4c8541aa8143464aa29696e1d957e9b5 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:29.913092 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f81e3-cb89-47f9-969b-fd3c2d4dfe7c None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:29.938534 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:29.964588 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a321141-3f85-485d-ae3f-26d37eedd74b None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:30.023889 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dd835-82f4-4d08-b9e5-36e19f78e3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:30.024874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dd835-82f4-4d08-b9e5-36e19f78e3a1 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:30.025226 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dd835-82f4-4d08-b9e5-36e19f78e3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:30.025572 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48dd835-82f4-4d08-b9e5-36e19f78e3a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:30.055542 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48dd835-82f4-4d08-b9e5-36e19f78e3a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:30.069904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-e48dd835-82f4-4d08-b9e5-36e19f78e3a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:30.069904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:30.069904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:30.069904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:30.069904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:30.069904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:30.069904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:30.069904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:30.069904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:30.069904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:30.069904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:30.069904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:30.069904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:30.069904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:30.069904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:30.069904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:30.070852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:30.070852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:30.070852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:30.070852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:30.070852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:30.070852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:30.070852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:30.070852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:30.070852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:30.070852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:30.070852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:30.070852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:30.070852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:30.070852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:30.070852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:30.070852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:30.071640 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:30.071640 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:30.071640 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:30.071640 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:30.071640 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:30.071640 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:30.071640 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:30.071640 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:30.071640 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:30.071640 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:30.071640 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:30.071640 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:30.071640 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 136/275] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:30.079051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dd835-82f4-4d08-b9e5-36e19f78e3a1 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:30.085533 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f81e3-cb89-47f9-969b-fd3c2d4dfe7c None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:30.125014 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:30.161775 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fbe73-f0ad-4bfd-81bf-42bc60e6cd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:30.162511 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fbe73-f0ad-4bfd-81bf-42bc60e6cd23 None admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:30.162850 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fbe73-f0ad-4bfd-81bf-42bc60e6cd23 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:30.163137 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722fbe73-f0ad-4bfd-81bf-42bc60e6cd23 None admin] PATH_INFO: `/v3/users` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:30.163872 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fbe73-f0ad-4bfd-81bf-42bc60e6cd23 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:30.165401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722fbe73-f0ad-4bfd-81bf-42bc60e6cd23 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:30.238907 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48dd835-82f4-4d08-b9e5-36e19f78e3a1 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:30.273478 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 140/276] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 12:49:29 2022] POST /identity/v3/users => generated 293 bytes in 361 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:49:30.287256 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7456f278-b56d-4134-81e6-bc5bb974f1ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:30.288017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456f278-b56d-4134-81e6-bc5bb974f1ac None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:30.288231 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456f278-b56d-4134-81e6-bc5bb974f1ac None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:30.288508 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7456f278-b56d-4134-81e6-bc5bb974f1ac None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:30.289314 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456f278-b56d-4134-81e6-bc5bb974f1ac None admin] RBAC: Adding query filter params (name=member) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:30.289626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456f278-b56d-4134-81e6-bc5bb974f1ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:30.291116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7456f278-b56d-4134-81e6-bc5bb974f1ac None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:30.294862 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:30.304357 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 137/277] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:30.310904 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fbe73-f0ad-4bfd-81bf-42bc60e6cd23 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:30.457470 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722fbe73-f0ad-4bfd-81bf-42bc60e6cd23 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:30.481953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce10f08-b0f0-4f24-a434-f08413eba377 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:30.482322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce10f08-b0f0-4f24-a434-f08413eba377 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:30.482521 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce10f08-b0f0-4f24-a434-f08413eba377 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:30.484761 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 138/278] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:49:30.490810 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36cc3b-0f05-4cbc-bb78-923331ac374c None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:30.491375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36cc3b-0f05-4cbc-bb78-923331ac374c None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:30.491851 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36cc3b-0f05-4cbc-bb78-923331ac374c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:30.503083 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fff4d-8983-4864-ab2c-f1a3aadf2821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:30.503983 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fff4d-8983-4864-ab2c-f1a3aadf2821 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:30.504248 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fff4d-8983-4864-ab2c-f1a3aadf2821 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:30.504556 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fff4d-8983-4864-ab2c-f1a3aadf2821 None admin] PATH_INFO: `/v3/users/3655018d6ade4aa4a0d76533534eb8db` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:30.513857 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-1f36cc3b-0f05-4cbc-bb78-923331ac374c None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:30.515139 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-1f36cc3b-0f05-4cbc-bb78-923331ac374c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:30.521006 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fff4d-8983-4864-ab2c-f1a3aadf2821 None admin] RBAC: Authorizing `identity:get_user(user_id=3655018d6ade4aa4a0d76533534eb8db)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:30.522512 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fff4d-8983-4864-ab2c-f1a3aadf2821 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:30.525156 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 141/279] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:30 2022] GET /identity/v3/users/3655018d6ade4aa4a0d76533534eb8db => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:30.530805 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fff4d-8983-4864-ab2c-f1a3aadf2821 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:30.568964 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:30.610306 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 139/280] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:30.634657 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36cc3b-0f05-4cbc-bb78-923331ac374c None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:30.665233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fff4d-8983-4864-ab2c-f1a3aadf2821 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:30.710070 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9638ea-5257-4cc8-ae45-503565a41ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:30.711364 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9638ea-5257-4cc8-ae45-503565a41ed2 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:30.711646 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9638ea-5257-4cc8-ae45-503565a41ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:30.711929 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9638ea-5257-4cc8-ae45-503565a41ed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:30.713310 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9638ea-5257-4cc8-ae45-503565a41ed2 None admin] RBAC: Adding query filter params (role.id=669c23212b4843c8900c3d2e58fb6e0f, user.id=3655018d6ade4aa4a0d76533534eb8db, scope.system=all) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:30.713634 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9638ea-5257-4cc8-ae45-503565a41ed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:30.716383 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9638ea-5257-4cc8-ae45-503565a41ed2 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:30.724248 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 142/281] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Jul 14 12:49:30 2022] GET /identity/v3/role_assignments?user.id=3655018d6ade4aa4a0d76533534eb8db&scope.system=all&role.id=669c23212b4843c8900c3d2e58fb6e0f => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:30.764209 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36cc3b-0f05-4cbc-bb78-923331ac374c None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:30.800100 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:30.814072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020de67-aead-41ac-8834-88db7304b885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:30.814892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020de67-aead-41ac-8834-88db7304b885 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:30.815178 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020de67-aead-41ac-8834-88db7304b885 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:30.815457 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020de67-aead-41ac-8834-88db7304b885 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:30.831572 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020de67-aead-41ac-8834-88db7304b885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:30.840136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-9020de67-aead-41ac-8834-88db7304b885 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 12:49:30.840136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:30.840136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:30.840136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:30.840136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:30.840136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:30.840136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:30.840136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:30.840136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:30.840136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:30.840136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:30.840136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:30.840136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:30.840136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:30.840136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:30.840136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:30.841119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:30.841119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:30.841119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:30.841119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:30.841119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:30.841119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:30.841119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:30.841119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:30.841119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:30.841119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:30.841119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:30.841119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:30.841119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:30.841119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:30.841119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:30.841119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:30.841898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:30.841898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:30.841898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:30.841898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:30.841898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:30.841898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:30.841898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:30.841898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:30.841898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:30.841898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:30.841898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 12:49:30.841898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:30.841898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 140/282] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:49:30.848665 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9638ea-5257-4cc8-ae45-503565a41ed2 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:30.981115 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:30.987710 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9638ea-5257-4cc8-ae45-503565a41ed2 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:31.025777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41c3c75-1fbf-4320-85a9-1cd4ac6761fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:31.026384 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c3c75-1fbf-4320-85a9-1cd4ac6761fc None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:31.026670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c3c75-1fbf-4320-85a9-1cd4ac6761fc None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:31.026947 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c3c75-1fbf-4320-85a9-1cd4ac6761fc None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:31.027698 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c3c75-1fbf-4320-85a9-1cd4ac6761fc None admin] RBAC: Adding query filter params (name=reader) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:31.028005 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c3c75-1fbf-4320-85a9-1cd4ac6761fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:31.029469 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41c3c75-1fbf-4320-85a9-1cd4ac6761fc None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:31.045674 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 143/283] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:31.051344 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020de67-aead-41ac-8834-88db7304b885 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:31.087462 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c016e-f9dd-4931-a020-1bce2a3c5e21 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:31.087776 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c016e-f9dd-4931-a020-1bce2a3c5e21 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:31.088026 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c016e-f9dd-4931-a020-1bce2a3c5e21 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:31.089589 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 144/284] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:49:31.097903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c8857-bbb4-4195-8330-8f38585b657f None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:31.098369 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c8857-bbb4-4195-8330-8f38585b657f None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:31.098752 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c8857-bbb4-4195-8330-8f38585b657f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:31.128328 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-6d4c8857-bbb4-4195-8330-8f38585b657f None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:31.135656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-6d4c8857-bbb4-4195-8330-8f38585b657f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:31.241356 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020de67-aead-41ac-8834-88db7304b885 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:31.279136 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 145/285] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:31.291721 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58eedb5-80ba-4a40-a21f-ac1e9e293ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:31.292661 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eedb5-80ba-4a40-a21f-ac1e9e293ef1 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:31.292975 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eedb5-80ba-4a40-a21f-ac1e9e293ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:31.293250 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58eedb5-80ba-4a40-a21f-ac1e9e293ef1 None admin] PATH_INFO: `/v3/users/ee1b8e1494544ecc968d3c44faf566ad` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:31.294452 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58eedb5-80ba-4a40-a21f-ac1e9e293ef1 None admin] RBAC: Authorizing `identity:get_user(user_id=ee1b8e1494544ecc968d3c44faf566ad)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:31.296446 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58eedb5-80ba-4a40-a21f-ac1e9e293ef1 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:31.298524 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 141/286] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:31 2022] GET /identity/v3/users/ee1b8e1494544ecc968d3c44faf566ad => generated 297 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:31.305754 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c8857-bbb4-4195-8330-8f38585b657f None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:31.314774 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58eedb5-80ba-4a40-a21f-ac1e9e293ef1 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:31.418813 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:31.435336 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c8857-bbb4-4195-8330-8f38585b657f None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:31.451801 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:31.477135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e9430-6beb-4011-a18b-2c1c30643d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:31.477135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e9430-6beb-4011-a18b-2c1c30643d1b None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:31.477135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e9430-6beb-4011-a18b-2c1c30643d1b None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:31.477135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54e9430-6beb-4011-a18b-2c1c30643d1b None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:31.478996 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e9430-6beb-4011-a18b-2c1c30643d1b None admin] RBAC: Authorizing `identity:get_project(project_id=4939ee9d222341dca515aa1fa4cff0d1)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:31.480792 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54e9430-6beb-4011-a18b-2c1c30643d1b None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:31.482883 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 146/287] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:31 2022] GET /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:31.489405 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e9430-6beb-4011-a18b-2c1c30643d1b None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:31.544426 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58eedb5-80ba-4a40-a21f-ac1e9e293ef1 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:31.605949 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54e9430-6beb-4011-a18b-2c1c30643d1b None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:31.616691 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd433c0b-aa39-4cc7-810d-1617f72adf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:31.616691 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd433c0b-aa39-4cc7-810d-1617f72adf53 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:31.616691 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd433c0b-aa39-4cc7-810d-1617f72adf53 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:31.616691 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd433c0b-aa39-4cc7-810d-1617f72adf53 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:31.628186 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd433c0b-aa39-4cc7-810d-1617f72adf53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:31.638533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-cd433c0b-aa39-4cc7-810d-1617f72adf53 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:31.638533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:31.638533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:31.638533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:31.638533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:31.638533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:31.638533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:31.638533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:31.638533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:31.638533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:31.638533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:31.638533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:31.638533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:31.638533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:31.638533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:31.638533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:31.647074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:31.647074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:31.647074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:31.647074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:31.647074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:31.647074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:31.647074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:31.647074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:31.647074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:31.647074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:31.647074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:31.647074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:31.647074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:31.647074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:31.647074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:31.647074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:31.647913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:31.647913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:31.647913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:31.647913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:31.647913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:31.647913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:31.647913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:31.647913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:31.647913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:31.647913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:31.647913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:31.647913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:31.647913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 142/288] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:31.647913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd433c0b-aa39-4cc7-810d-1617f72adf53 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:31.729358 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93085f2b-28f5-49fa-bf4f-9d8648354a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:31.730527 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93085f2b-28f5-49fa-bf4f-9d8648354a80 None admin] REQUEST_METHOD: `PUT` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:31.730963 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93085f2b-28f5-49fa-bf4f-9d8648354a80 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:31.731386 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93085f2b-28f5-49fa-bf4f-9d8648354a80 None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1/users/ee1b8e1494544ecc968d3c44faf566ad/roles/c3cd9bef86d3428c8b7a2914eb37e097` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:31.741491 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93085f2b-28f5-49fa-bf4f-9d8648354a80 None admin] RBAC: Authorizing `identity:create_grant(project_id=4939ee9d222341dca515aa1fa4cff0d1, user_id=ee1b8e1494544ecc968d3c44faf566ad, role_id=c3cd9bef86d3428c8b7a2914eb37e097)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:31.743223 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93085f2b-28f5-49fa-bf4f-9d8648354a80 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:31.767021 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd433c0b-aa39-4cc7-810d-1617f72adf53 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:31.785666 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:31.804047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50283b-53f5-476f-8453-d5efebad22af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:31.804661 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50283b-53f5-476f-8453-d5efebad22af None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:31.804967 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50283b-53f5-476f-8453-d5efebad22af None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:31.805306 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50283b-53f5-476f-8453-d5efebad22af None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:31.806213 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50283b-53f5-476f-8453-d5efebad22af None admin] RBAC: Adding query filter params (name=member) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:31.806532 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50283b-53f5-476f-8453-d5efebad22af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:31.807993 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa50283b-53f5-476f-8453-d5efebad22af None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:31.822419 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 143/289] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:31.823824 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50283b-53f5-476f-8453-d5efebad22af None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:31.879170 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 147/290] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 12:49:31 2022] PUT /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1/users/ee1b8e1494544ecc968d3c44faf566ad/roles/c3cd9bef86d3428c8b7a2914eb37e097 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:49:31.952780 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50283b-53f5-476f-8453-d5efebad22af None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:31.990741 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086e1de-25fc-4bf2-acac-6443486d306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:31.991632 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086e1de-25fc-4bf2-acac-6443486d306d None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:31.991918 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086e1de-25fc-4bf2-acac-6443486d306d None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:31.992189 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c086e1de-25fc-4bf2-acac-6443486d306d None admin] PATH_INFO: `/v3/users/d6c33dd657f74421b2c08c9140a2a263` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:31.993472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086e1de-25fc-4bf2-acac-6443486d306d None admin] RBAC: Authorizing `identity:get_user(user_id=d6c33dd657f74421b2c08c9140a2a263)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:31.994978 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c086e1de-25fc-4bf2-acac-6443486d306d None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:32.000847 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 144/291] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:31 2022] GET /identity/v3/users/d6c33dd657f74421b2c08c9140a2a263 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:32.005832 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93085f2b-28f5-49fa-bf4f-9d8648354a80 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:32.042092 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:32.164411 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93085f2b-28f5-49fa-bf4f-9d8648354a80 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:32.204230 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09963d53-3f3e-417d-aa66-80b85610e9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:32.204921 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09963d53-3f3e-417d-aa66-80b85610e9a7 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:32.205205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09963d53-3f3e-417d-aa66-80b85610e9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:32.205475 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09963d53-3f3e-417d-aa66-80b85610e9a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:32.284698 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09963d53-3f3e-417d-aa66-80b85610e9a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:32.286609 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09963d53-3f3e-417d-aa66-80b85610e9a7 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:32.303392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:32.399878 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 148/292] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:32.401631 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086e1de-25fc-4bf2-acac-6443486d306d None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:32.458237 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:32.512253 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c086e1de-25fc-4bf2-acac-6443486d306d None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:32.548487 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df1079c-a3f2-401a-aaa7-55b8f3195e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:32.549395 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1079c-a3f2-401a-aaa7-55b8f3195e9c None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:32.549821 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1079c-a3f2-401a-aaa7-55b8f3195e9c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:32.550098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df1079c-a3f2-401a-aaa7-55b8f3195e9c None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:32.551296 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1079c-a3f2-401a-aaa7-55b8f3195e9c None admin] RBAC: Authorizing `identity:get_project(project_id=4939ee9d222341dca515aa1fa4cff0d1)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:32.552797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df1079c-a3f2-401a-aaa7-55b8f3195e9c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:32.559351 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 145/293] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:32 2022] GET /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:32.560786 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09963d53-3f3e-417d-aa66-80b85610e9a7 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:32.664661 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09963d53-3f3e-417d-aa66-80b85610e9a7 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:32.679576 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:32.700071 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0da780-98b5-4c8e-b7f6-2816e4693c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:32.700769 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0da780-98b5-4c8e-b7f6-2816e4693c39 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:32.701056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0da780-98b5-4c8e-b7f6-2816e4693c39 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:32.701335 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0da780-98b5-4c8e-b7f6-2816e4693c39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:32.702752 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0da780-98b5-4c8e-b7f6-2816e4693c39 None admin] RBAC: Adding query filter params (role.id=669c23212b4843c8900c3d2e58fb6e0f, scope.project.id=4939ee9d222341dca515aa1fa4cff0d1, user.id=d6c33dd657f74421b2c08c9140a2a263) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:32.703073 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0da780-98b5-4c8e-b7f6-2816e4693c39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:32.704520 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0da780-98b5-4c8e-b7f6-2816e4693c39 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:32.716721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 149/294] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:49:32 2022] GET /identity/v3/role_assignments?user.id=d6c33dd657f74421b2c08c9140a2a263&scope.project.id=4939ee9d222341dca515aa1fa4cff0d1&role.id=669c23212b4843c8900c3d2e58fb6e0f => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:33.143174 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052dc27-75d3-4199-9073-aa494c35eac0 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:33.143487 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052dc27-75d3-4199-9073-aa494c35eac0 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:33.143743 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2052dc27-75d3-4199-9073-aa494c35eac0 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:33.145163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 146/295] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:33.153294 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58323f-37fa-4fe8-85f2-5bd7874d22fc None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:33.153569 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58323f-37fa-4fe8-85f2-5bd7874d22fc None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:33.153855 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b58323f-37fa-4fe8-85f2-5bd7874d22fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:33.173618 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-2b58323f-37fa-4fe8-85f2-5bd7874d22fc None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:33.174857 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-2b58323f-37fa-4fe8-85f2-5bd7874d22fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:33.250667 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 150/296] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:33.275889 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052dc27-75d3-4199-9073-aa494c35eac0 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:33.379754 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d73023-671f-49fa-a447-919409434796 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:33.380117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d73023-671f-49fa-a447-919409434796 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:33.380321 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d73023-671f-49fa-a447-919409434796 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:33.382230 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 151/297] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:49:33.389734 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2052dc27-75d3-4199-9073-aa494c35eac0 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:33.390038 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60d1fb-1bf6-418e-a35d-bd03819db59b None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:33.390433 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60d1fb-1bf6-418e-a35d-bd03819db59b None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:33.390818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff60d1fb-1bf6-418e-a35d-bd03819db59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:33.407165 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:33.413246 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-ff60d1fb-1bf6-418e-a35d-bd03819db59b None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:33.414634 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-ff60d1fb-1bf6-418e-a35d-bd03819db59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:33.432791 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89234a-14ad-46b5-bd1d-2d18d1fe6959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:33.434009 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89234a-14ad-46b5-bd1d-2d18d1fe6959 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:33.434525 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89234a-14ad-46b5-bd1d-2d18d1fe6959 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:33.434956 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb89234a-14ad-46b5-bd1d-2d18d1fe6959 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:33.450116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb89234a-14ad-46b5-bd1d-2d18d1fe6959 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:33.459752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-bb89234a-14ad-46b5-bd1d-2d18d1fe6959 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 12:49:33.459752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:33.459752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:33.459752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:33.459752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:33.459752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:33.459752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:33.459752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:33.459752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:33.459752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:33.459752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:33.459752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:33.459752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:33.459752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:33.459752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:33.459752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:33.460686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:33.460686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:33.460686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:33.460686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:33.460686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:33.460686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:33.460686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:33.460686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:33.460686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:33.460686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:33.460686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:33.460686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:33.460686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:33.460686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:33.460686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:33.460686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:33.461481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:33.461481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:33.461481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:33.461481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:33.461481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:33.461481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:33.461481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:33.461481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:33.461481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:33.461481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:33.461481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 12:49:33.461481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:33.464380 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 147/298] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:33.471474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89234a-14ad-46b5-bd1d-2d18d1fe6959 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:33.517476 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 152/299] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:33.542522 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60d1fb-1bf6-418e-a35d-bd03819db59b None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:33.591066 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:33.592213 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb89234a-14ad-46b5-bd1d-2d18d1fe6959 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:33.627852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eac0ae-8f15-44f8-8804-63fdcba341e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:33.628520 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eac0ae-8f15-44f8-8804-63fdcba341e9 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:33.628842 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eac0ae-8f15-44f8-8804-63fdcba341e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:33.629119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eac0ae-8f15-44f8-8804-63fdcba341e9 None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:33.629863 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eac0ae-8f15-44f8-8804-63fdcba341e9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:33.630171 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eac0ae-8f15-44f8-8804-63fdcba341e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:33.631560 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eac0ae-8f15-44f8-8804-63fdcba341e9 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:33.645520 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 148/300] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:33.645520 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a5e18-e492-41c1-aa6b-f02fff611bed None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:33.645520 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a5e18-e492-41c1-aa6b-f02fff611bed None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:33.645520 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3a5e18-e492-41c1-aa6b-f02fff611bed None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:33.645520 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 149/301] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:33.649818 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e0814-d2a9-4cb4-aefa-ccecda6e5b4b None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:33.650119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e0814-d2a9-4cb4-aefa-ccecda6e5b4b None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:33.650753 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e0814-d2a9-4cb4-aefa-ccecda6e5b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:33.660010 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff60d1fb-1bf6-418e-a35d-bd03819db59b None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:33.672564 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-458e0814-d2a9-4cb4-aefa-ccecda6e5b4b None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:33.673829 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-458e0814-d2a9-4cb4-aefa-ccecda6e5b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:33.697364 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16693fe2-48fd-479b-9944-70edd25da8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:33.698265 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16693fe2-48fd-479b-9944-70edd25da8a5 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:33.698731 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16693fe2-48fd-479b-9944-70edd25da8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:33.698928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16693fe2-48fd-479b-9944-70edd25da8a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:33.700082 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16693fe2-48fd-479b-9944-70edd25da8a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:33.701842 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16693fe2-48fd-479b-9944-70edd25da8a5 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:33.708899 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 153/302] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:49:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:33.709081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:33.709172 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16693fe2-48fd-479b-9944-70edd25da8a5 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:33.747452 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 150/303] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:33.750365 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e0814-d2a9-4cb4-aefa-ccecda6e5b4b None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:33.817096 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16693fe2-48fd-479b-9944-70edd25da8a5 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:33.824475 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:33.857782 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6eae6a-56a5-4363-97ec-a66185e8dba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:33.859534 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6eae6a-56a5-4363-97ec-a66185e8dba9 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:33.860081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6eae6a-56a5-4363-97ec-a66185e8dba9 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:33.860540 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6eae6a-56a5-4363-97ec-a66185e8dba9 None admin] PATH_INFO: `/v3/users/5698171a43b24b24aa64a078b8392687` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:33.864441 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e0814-d2a9-4cb4-aefa-ccecda6e5b4b None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:33.878223 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6eae6a-56a5-4363-97ec-a66185e8dba9 None admin] RBAC: Authorizing `identity:get_user(user_id=5698171a43b24b24aa64a078b8392687)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:33.880133 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6eae6a-56a5-4363-97ec-a66185e8dba9 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:33.886979 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 154/304] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:33 2022] GET /identity/v3/users/5698171a43b24b24aa64a078b8392687 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:33.888044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6eae6a-56a5-4363-97ec-a66185e8dba9 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:33.899617 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77f70f-a23b-4184-901b-48042815db7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:33.900219 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f70f-a23b-4184-901b-48042815db7b None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:33.900498 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f70f-a23b-4184-901b-48042815db7b None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:33.900824 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a77f70f-a23b-4184-901b-48042815db7b None admin] PATH_INFO: `/v3/groups` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:33.901508 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77f70f-a23b-4184-901b-48042815db7b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:33.902952 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a77f70f-a23b-4184-901b-48042815db7b None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:33.969297 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 151/305] 10.222.0.40 () {60 vars in 1134 bytes} [Thu Jul 14 12:49:33 2022] POST /identity/v3/groups => generated 229 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:49:33.970143 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77f70f-a23b-4184-901b-48042815db7b None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:34.009107 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:34.013537 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6eae6a-56a5-4363-97ec-a66185e8dba9 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:34.061475 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dffc9c-d10c-40bb-b4ec-01749991ffef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:34.064096 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dffc9c-d10c-40bb-b4ec-01749991ffef None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:34.064558 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dffc9c-d10c-40bb-b4ec-01749991ffef None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:34.065023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dffc9c-d10c-40bb-b4ec-01749991ffef None admin] PATH_INFO: `/v3/roles/member` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:34.084029 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dffc9c-d10c-40bb-b4ec-01749991ffef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:34.096120 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-e4dffc9c-d10c-40bb-b4ec-01749991ffef None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:34.096120 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:34.096120 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:34.096120 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:34.096120 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:34.096120 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:34.096120 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:34.096120 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:34.096120 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:34.096120 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:34.096120 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:34.096120 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:34.096120 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:34.096120 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:34.096120 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:34.096120 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:34.097292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:34.097292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:34.097292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:34.097292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:34.097292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:34.097292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:34.097292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:34.097292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:34.097292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:34.097292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:34.097292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:34.097292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:34.097292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:34.097292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:34.097292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:34.097292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:34.098368 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:34.098368 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:34.098368 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:34.098368 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:34.098368 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:34.098368 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:34.098368 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:34.098368 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:34.098368 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:34.098368 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:34.098368 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:34.098368 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:34.101562 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 155/306] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:34.106518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a77f70f-a23b-4184-901b-48042815db7b None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:34.107693 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dffc9c-d10c-40bb-b4ec-01749991ffef None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:34.151461 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fd9cd-98af-45c1-98bb-1098e262a4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:34.152582 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fd9cd-98af-45c1-98bb-1098e262a4bf None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:34.153085 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:34.153574 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fd9cd-98af-45c1-98bb-1098e262a4bf None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:34.154698 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3fd9cd-98af-45c1-98bb-1098e262a4bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:34.155918 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fd9cd-98af-45c1-98bb-1098e262a4bf None admin] RBAC: Adding query filter params (role.id=c3cd9bef86d3428c8b7a2914eb37e097, user.id=5698171a43b24b24aa64a078b8392687, scope.system=all) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:34.156443 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fd9cd-98af-45c1-98bb-1098e262a4bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:34.157978 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3fd9cd-98af-45c1-98bb-1098e262a4bf None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:34.163847 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 152/307] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Jul 14 12:49:33 2022] GET /identity/v3/role_assignments?user.id=5698171a43b24b24aa64a078b8392687&scope.system=all&role.id=c3cd9bef86d3428c8b7a2914eb37e097 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:34.246982 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dffc9c-d10c-40bb-b4ec-01749991ffef None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:34.286646 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ccabd-8c9d-4b82-8bac-b2a94a94a38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:34.287631 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ccabd-8c9d-4b82-8bac-b2a94a94a38f None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:34.288065 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ccabd-8c9d-4b82-8bac-b2a94a94a38f None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:34.288518 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2ccabd-8c9d-4b82-8bac-b2a94a94a38f None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:34.289477 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ccabd-8c9d-4b82-8bac-b2a94a94a38f None admin] RBAC: Adding query filter params (name=member) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:34.289936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ccabd-8c9d-4b82-8bac-b2a94a94a38f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:34.291580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2ccabd-8c9d-4b82-8bac-b2a94a94a38f None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:34.302500 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 156/308] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:34.308557 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fd9cd-98af-45c1-98bb-1098e262a4bf None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:34.416287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:34.426175 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3fd9cd-98af-45c1-98bb-1098e262a4bf None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:34.465186 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ec37e-ede7-46b8-a4aa-15fd4cf7f387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:34.466069 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ec37e-ede7-46b8-a4aa-15fd4cf7f387 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:34.466350 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ec37e-ede7-46b8-a4aa-15fd4cf7f387 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:34.466623 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ec37e-ede7-46b8-a4aa-15fd4cf7f387 None admin] PATH_INFO: `/v3/users/3655018d6ade4aa4a0d76533534eb8db` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:34.467884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ec37e-ede7-46b8-a4aa-15fd4cf7f387 None admin] RBAC: Authorizing `identity:get_user(user_id=3655018d6ade4aa4a0d76533534eb8db)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:34.469390 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ec37e-ede7-46b8-a4aa-15fd4cf7f387 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:34.471343 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 153/309] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:34 2022] GET /identity/v3/users/3655018d6ade4aa4a0d76533534eb8db => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:34.477128 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ccabd-8c9d-4b82-8bac-b2a94a94a38f None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:34.579584 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:34.597655 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2ccabd-8c9d-4b82-8bac-b2a94a94a38f None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:34.633170 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501d0f7-55bd-4189-a7a1-4d380e8a9dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:34.634042 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501d0f7-55bd-4189-a7a1-4d380e8a9dea None admin] REQUEST_METHOD: `PUT` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:34.634327 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501d0f7-55bd-4189-a7a1-4d380e8a9dea None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:34.636472 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501d0f7-55bd-4189-a7a1-4d380e8a9dea None admin] PATH_INFO: `/v3/system/users/3655018d6ade4aa4a0d76533534eb8db/roles/669c23212b4843c8900c3d2e58fb6e0f` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:34.636472 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501d0f7-55bd-4189-a7a1-4d380e8a9dea None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3655018d6ade4aa4a0d76533534eb8db, role_id=669c23212b4843c8900c3d2e58fb6e0f)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:34.637558 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501d0f7-55bd-4189-a7a1-4d380e8a9dea None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:34.698377 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac44a9-9e5c-4bb3-8c08-44ab99d08344 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:34.698961 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac44a9-9e5c-4bb3-8c08-44ab99d08344 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:34.699243 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac44a9-9e5c-4bb3-8c08-44ab99d08344 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:34.703491 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 154/310] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:34.706535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc20c37-e70a-47f3-b8f7-ef4e65f2bef1 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:34.716752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc20c37-e70a-47f3-b8f7-ef4e65f2bef1 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:34.716752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc20c37-e70a-47f3-b8f7-ef4e65f2bef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:34.724907 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-abc20c37-e70a-47f3-b8f7-ef4e65f2bef1 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:34.726101 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-abc20c37-e70a-47f3-b8f7-ef4e65f2bef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:34.800678 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 155/311] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:34.822953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc20c37-e70a-47f3-b8f7-ef4e65f2bef1 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:34.825651 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 157/312] 10.222.0.40 () {58 vars in 1334 bytes} [Thu Jul 14 12:49:34 2022] PUT /identity/v3/system/users/3655018d6ade4aa4a0d76533534eb8db/roles/669c23212b4843c8900c3d2e58fb6e0f => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:49:34.933026 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:34.947235 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc20c37-e70a-47f3-b8f7-ef4e65f2bef1 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:34.988596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf473f-23e5-4c0a-852a-1064c9d00744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:34.989999 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf473f-23e5-4c0a-852a-1064c9d00744 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:34.990471 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf473f-23e5-4c0a-852a-1064c9d00744 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:34.991041 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf473f-23e5-4c0a-852a-1064c9d00744 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:35.003035 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf473f-23e5-4c0a-852a-1064c9d00744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:35.011157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-afdf473f-23e5-4c0a-852a-1064c9d00744 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 12:49:35.011157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:35.011157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:35.011157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:35.011157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:35.011157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:35.011157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:35.011157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:35.011157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:35.011157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:35.011157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:35.011157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:35.011157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:35.011157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:35.011157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:35.011157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:35.012025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:35.012025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:35.012025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:35.012025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:35.012025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:35.012025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:35.012025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:35.012025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:35.012025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:35.012025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:35.012025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:35.012025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:35.012025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:35.012025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:35.012025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:35.012025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:35.012867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:35.012867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:35.012867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:35.012867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:35.012867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:35.012867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:35.012867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:35.012867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:35.012867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:35.012867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:35.012867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 12:49:35.012867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:35.016660 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 156/313] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:35.020682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501d0f7-55bd-4189-a7a1-4d380e8a9dea None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:35.130703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501d0f7-55bd-4189-a7a1-4d380e8a9dea None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:35.166598 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebde720-2611-4786-9ab0-ffc279659855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:35.167624 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebde720-2611-4786-9ab0-ffc279659855 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:35.168106 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebde720-2611-4786-9ab0-ffc279659855 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:35.168608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebde720-2611-4786-9ab0-ffc279659855 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:35.169569 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebde720-2611-4786-9ab0-ffc279659855 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:35.170071 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebde720-2611-4786-9ab0-ffc279659855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:35.172204 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebde720-2611-4786-9ab0-ffc279659855 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:35.181623 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 158/314] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:35.187440 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf473f-23e5-4c0a-852a-1064c9d00744 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:35.295833 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf473f-23e5-4c0a-852a-1064c9d00744 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:35.332614 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5515ffd-094b-4c1e-8101-aa90a8817f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:35.333783 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5515ffd-094b-4c1e-8101-aa90a8817f6a None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:35.334068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5515ffd-094b-4c1e-8101-aa90a8817f6a None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:35.334347 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5515ffd-094b-4c1e-8101-aa90a8817f6a None admin] PATH_INFO: `/v3/users/ee1b8e1494544ecc968d3c44faf566ad` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:35.335651 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5515ffd-094b-4c1e-8101-aa90a8817f6a None admin] RBAC: Authorizing `identity:get_user(user_id=ee1b8e1494544ecc968d3c44faf566ad)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:35.337211 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5515ffd-094b-4c1e-8101-aa90a8817f6a None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:35.339312 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 157/315] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:35 2022] GET /identity/v3/users/ee1b8e1494544ecc968d3c44faf566ad => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:35.345468 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebde720-2611-4786-9ab0-ffc279659855 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:35.367880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:35.460083 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebde720-2611-4786-9ab0-ffc279659855 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:35.496695 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572b96d-765d-4c3e-8bdf-79f63a08d7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:35.497686 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572b96d-765d-4c3e-8bdf-79f63a08d7e3 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:35.498340 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572b96d-765d-4c3e-8bdf-79f63a08d7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:35.498835 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4572b96d-765d-4c3e-8bdf-79f63a08d7e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:35.568217 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572b96d-765d-4c3e-8bdf-79f63a08d7e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:35.570135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4572b96d-765d-4c3e-8bdf-79f63a08d7e3 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:35.595261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:35.678136 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 159/316] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:35.683758 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5515ffd-094b-4c1e-8101-aa90a8817f6a None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:35.703216 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:35.810333 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5515ffd-094b-4c1e-8101-aa90a8817f6a None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:35.846540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080b590d-e5ac-4557-9e05-64c46f605fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:35.847322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b590d-e5ac-4557-9e05-64c46f605fde None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:35.847609 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b590d-e5ac-4557-9e05-64c46f605fde None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:35.847890 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080b590d-e5ac-4557-9e05-64c46f605fde None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:35.849133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b590d-e5ac-4557-9e05-64c46f605fde None admin] RBAC: Authorizing `identity:get_project(project_id=4939ee9d222341dca515aa1fa4cff0d1)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:35.850579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080b590d-e5ac-4557-9e05-64c46f605fde None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:35.852592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 158/317] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:35 2022] GET /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:35.858139 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572b96d-765d-4c3e-8bdf-79f63a08d7e3 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:35.961002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4572b96d-765d-4c3e-8bdf-79f63a08d7e3 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:35.977058 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:35.996368 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3bbfb7-09c0-4664-83a7-f24b5a67aa26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:35.997169 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bbfb7-09c0-4664-83a7-f24b5a67aa26 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:35.997457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bbfb7-09c0-4664-83a7-f24b5a67aa26 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:35.997733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3bbfb7-09c0-4664-83a7-f24b5a67aa26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:35.998621 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bbfb7-09c0-4664-83a7-f24b5a67aa26 None admin] RBAC: Adding query filter params (role.id=c3cd9bef86d3428c8b7a2914eb37e097, scope.project.id=4939ee9d222341dca515aa1fa4cff0d1, user.id=ee1b8e1494544ecc968d3c44faf566ad) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:35.998941 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bbfb7-09c0-4664-83a7-f24b5a67aa26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:36.000937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3bbfb7-09c0-4664-83a7-f24b5a67aa26 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:36.007587 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 160/318] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:49:35 2022] GET /identity/v3/role_assignments?user.id=ee1b8e1494544ecc968d3c44faf566ad&scope.project.id=4939ee9d222341dca515aa1fa4cff0d1&role.id=c3cd9bef86d3428c8b7a2914eb37e097 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:36.423068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab311d-5738-4f6d-b668-2096d55223d4 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:36.423420 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab311d-5738-4f6d-b668-2096d55223d4 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:36.423591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdab311d-5738-4f6d-b668-2096d55223d4 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:36.425081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 159/319] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:36.430373 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b520c36-77f8-4d1c-8ec3-27b03e6dac83 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:36.430664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b520c36-77f8-4d1c-8ec3-27b03e6dac83 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:36.430939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b520c36-77f8-4d1c-8ec3-27b03e6dac83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:36.447722 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-6b520c36-77f8-4d1c-8ec3-27b03e6dac83 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:36.448931 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-6b520c36-77f8-4d1c-8ec3-27b03e6dac83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:36.495544 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180522f8-bcca-43df-9341-48464cf9daa6 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:36.495865 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180522f8-bcca-43df-9341-48464cf9daa6 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:36.496122 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180522f8-bcca-43df-9341-48464cf9daa6 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:36.497658 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 160/320] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:36.503121 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1d660-bbbe-4214-a09f-d8b0853f010a None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:36.503423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1d660-bbbe-4214-a09f-d8b0853f010a None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:36.503706 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1d660-bbbe-4214-a09f-d8b0853f010a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:36.519765 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 161/321] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:36.524844 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-fdc1d660-bbbe-4214-a09f-d8b0853f010a None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:36.524844 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-fdc1d660-bbbe-4214-a09f-d8b0853f010a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:36.543413 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b520c36-77f8-4d1c-8ec3-27b03e6dac83 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:36.602827 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 161/322] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:36.626321 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1d660-bbbe-4214-a09f-d8b0853f010a None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:36.642636 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:36.665518 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b520c36-77f8-4d1c-8ec3-27b03e6dac83 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:36.673234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:36.701356 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d0cdc-02a8-4da8-acab-35afa42bd357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:36.702151 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d0cdc-02a8-4da8-acab-35afa42bd357 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:36.702499 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d0cdc-02a8-4da8-acab-35afa42bd357 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:36.702781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565d0cdc-02a8-4da8-acab-35afa42bd357 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:36.703978 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d0cdc-02a8-4da8-acab-35afa42bd357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:36.705478 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565d0cdc-02a8-4da8-acab-35afa42bd357 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:36.710733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 162/323] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:49:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:36.712907 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d0cdc-02a8-4da8-acab-35afa42bd357 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:36.742442 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1d660-bbbe-4214-a09f-d8b0853f010a None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:36.781494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0ffed-e153-4d9a-8e38-d028f737c53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:36.782304 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0ffed-e153-4d9a-8e38-d028f737c53b None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:36.782592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0ffed-e153-4d9a-8e38-d028f737c53b None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:36.782869 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0ffed-e153-4d9a-8e38-d028f737c53b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:36.794074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0ffed-e153-4d9a-8e38-d028f737c53b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:36.802037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-09f0ffed-e153-4d9a-8e38-d028f737c53b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 12:49:36.802037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:36.802037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:36.802037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:36.802037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:36.802037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:36.802037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:36.802037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:36.802037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:36.802037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:36.802037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:36.802037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:36.802037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:36.802037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:36.802037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:36.802037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:36.802970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:36.802970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:36.802970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:36.802970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:36.802970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:36.802970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:36.802970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:36.802970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:36.802970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:36.802970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:36.802970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:36.802970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:36.802970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:36.802970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:36.802970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:36.802970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:36.803745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:36.803745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:36.803745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:36.803745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:36.803745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:36.803745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:36.803745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:36.803745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:36.803745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:36.803745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:36.803745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 12:49:36.803745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:36.803745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 162/324] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:49:36.809270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0ffed-e153-4d9a-8e38-d028f737c53b None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:36.831036 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565d0cdc-02a8-4da8-acab-35afa42bd357 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:36.870684 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392cc36-aefe-4a36-bc68-1dc5b59bfbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:36.871355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392cc36-aefe-4a36-bc68-1dc5b59bfbcd None admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:36.871641 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392cc36-aefe-4a36-bc68-1dc5b59bfbcd None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:36.872067 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392cc36-aefe-4a36-bc68-1dc5b59bfbcd None admin] PATH_INFO: `/v3/groups` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:36.872595 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392cc36-aefe-4a36-bc68-1dc5b59bfbcd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:36.874698 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392cc36-aefe-4a36-bc68-1dc5b59bfbcd None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:36.889596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:36.914678 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0ffed-e153-4d9a-8e38-d028f737c53b None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:36.947906 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc10eb-b62f-4c21-9101-d929a116026a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:36.948505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc10eb-b62f-4c21-9101-d929a116026a None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:36.948808 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc10eb-b62f-4c21-9101-d929a116026a None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:36.949084 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc10eb-b62f-4c21-9101-d929a116026a None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:36.949830 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc10eb-b62f-4c21-9101-d929a116026a None admin] RBAC: Adding query filter params (name=reader) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:36.950138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc10eb-b62f-4c21-9101-d929a116026a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:36.951576 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc10eb-b62f-4c21-9101-d929a116026a None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:36.960441 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 163/325] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:36.966097 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc10eb-b62f-4c21-9101-d929a116026a None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:36.992670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 163/326] 10.222.0.40 () {60 vars in 1134 bytes} [Thu Jul 14 12:49:36 2022] POST /identity/v3/groups => generated 226 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:49:37.092906 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc10eb-b62f-4c21-9101-d929a116026a None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:37.135296 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa08f07f-831e-43ab-bbc3-e41eb96d54a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:37.136238 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08f07f-831e-43ab-bbc3-e41eb96d54a1 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:37.136528 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08f07f-831e-43ab-bbc3-e41eb96d54a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:37.136841 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa08f07f-831e-43ab-bbc3-e41eb96d54a1 None admin] PATH_INFO: `/v3/users/5698171a43b24b24aa64a078b8392687` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:37.141631 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08f07f-831e-43ab-bbc3-e41eb96d54a1 None admin] RBAC: Authorizing `identity:get_user(user_id=5698171a43b24b24aa64a078b8392687)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:37.143483 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa08f07f-831e-43ab-bbc3-e41eb96d54a1 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:37.145580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 164/327] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:36 2022] GET /identity/v3/users/5698171a43b24b24aa64a078b8392687 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:37.151202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392cc36-aefe-4a36-bc68-1dc5b59bfbcd None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:37.165701 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0d202-362a-461c-9c61-40b5e4f61fef None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:37.166233 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0d202-362a-461c-9c61-40b5e4f61fef None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:37.166628 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df0d202-362a-461c-9c61-40b5e4f61fef None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:37.168147 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 165/328] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:49:37.174657 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35627a-4c90-4f13-9861-757d5c84cfc5 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:37.174951 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35627a-4c90-4f13-9861-757d5c84cfc5 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:37.175227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed35627a-4c90-4f13-9861-757d5c84cfc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:37.182271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:37.192113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:37.195348 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-ed35627a-4c90-4f13-9861-757d5c84cfc5 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:37.195791 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-ed35627a-4c90-4f13-9861-757d5c84cfc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:37.267430 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392cc36-aefe-4a36-bc68-1dc5b59bfbcd None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:37.286630 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 166/329] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:37.310361 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35627a-4c90-4f13-9861-757d5c84cfc5 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:37.310578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc47898-c15f-4323-8630-57e2d1633857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:37.311296 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc47898-c15f-4323-8630-57e2d1633857 None admin] REQUEST_METHOD: `PUT` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:37.311611 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc47898-c15f-4323-8630-57e2d1633857 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:37.311897 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc47898-c15f-4323-8630-57e2d1633857 None admin] PATH_INFO: `/v3/system/users/5698171a43b24b24aa64a078b8392687/roles/c3cd9bef86d3428c8b7a2914eb37e097` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:37.313736 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc47898-c15f-4323-8630-57e2d1633857 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5698171a43b24b24aa64a078b8392687, role_id=c3cd9bef86d3428c8b7a2914eb37e097)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:37.315131 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc47898-c15f-4323-8630-57e2d1633857 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:37.404411 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 164/330] 10.222.0.40 () {58 vars in 1334 bytes} [Thu Jul 14 12:49:37 2022] PUT /identity/v3/system/users/5698171a43b24b24aa64a078b8392687/roles/c3cd9bef86d3428c8b7a2914eb37e097 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:49:37.416456 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed35627a-4c90-4f13-9861-757d5c84cfc5 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:37.462531 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d5f75-7f00-4b00-8083-3b8cd3996237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:37.463531 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d5f75-7f00-4b00-8083-3b8cd3996237 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:37.463816 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d5f75-7f00-4b00-8083-3b8cd3996237 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:37.464087 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d5f75-7f00-4b00-8083-3b8cd3996237 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:37.467019 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:37.479759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d5f75-7f00-4b00-8083-3b8cd3996237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:37.488305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-d03d5f75-7f00-4b00-8083-3b8cd3996237 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:37.488305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:37.488305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:37.488305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:37.488305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:37.488305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:37.488305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:37.488305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:37.488305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:37.488305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:37.488305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:37.488305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:37.488305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:37.488305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:37.488305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:37.488305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:37.496116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:37.496116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:37.496116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:37.496116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:37.496116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:37.496116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:37.496116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:37.496116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:37.496116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:37.496116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:37.496116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:37.496116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:37.496116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:37.496116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:37.496116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:37.496116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:37.497078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:37.497078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:37.497078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:37.497078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:37.497078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:37.497078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:37.497078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:37.497078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:37.497078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:37.497078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:37.497078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:37.497078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:37.497078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 167/331] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:49:37.497738 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc47898-c15f-4323-8630-57e2d1633857 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:37.620987 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc47898-c15f-4323-8630-57e2d1633857 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:37.621390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:37.658961 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e6ff0-7bbc-4a6a-80e7-b6c7a4c96100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:37.659688 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e6ff0-7bbc-4a6a-80e7-b6c7a4c96100 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:37.660477 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e6ff0-7bbc-4a6a-80e7-b6c7a4c96100 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:37.660786 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309e6ff0-7bbc-4a6a-80e7-b6c7a4c96100 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:37.661548 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e6ff0-7bbc-4a6a-80e7-b6c7a4c96100 None admin] RBAC: Adding query filter params (name=member) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:37.661864 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e6ff0-7bbc-4a6a-80e7-b6c7a4c96100 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:37.663247 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309e6ff0-7bbc-4a6a-80e7-b6c7a4c96100 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:37.672923 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 165/332] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:37.678781 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d5f75-7f00-4b00-8083-3b8cd3996237 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:37.793049 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d5f75-7f00-4b00-8083-3b8cd3996237 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:37.833065 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e05aedc-befb-47bd-98e9-9f971ccfb0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:37.834216 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05aedc-befb-47bd-98e9-9f971ccfb0b2 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:37.834492 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05aedc-befb-47bd-98e9-9f971ccfb0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:37.834763 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e05aedc-befb-47bd-98e9-9f971ccfb0b2 None admin] PATH_INFO: `/v3/users/3655018d6ade4aa4a0d76533534eb8db` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:37.835981 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05aedc-befb-47bd-98e9-9f971ccfb0b2 None admin] RBAC: Authorizing `identity:get_user(user_id=3655018d6ade4aa4a0d76533534eb8db)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:37.837479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e05aedc-befb-47bd-98e9-9f971ccfb0b2 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:37.839545 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 168/333] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:37 2022] GET /identity/v3/users/3655018d6ade4aa4a0d76533534eb8db => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:37.845243 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e6ff0-7bbc-4a6a-80e7-b6c7a4c96100 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:37.961491 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309e6ff0-7bbc-4a6a-80e7-b6c7a4c96100 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:37.996960 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c628e1-364a-485a-afb0-1fc1c2e78e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:37.997625 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c628e1-364a-485a-afb0-1fc1c2e78e6d None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:37.997902 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c628e1-364a-485a-afb0-1fc1c2e78e6d None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:37.998178 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c628e1-364a-485a-afb0-1fc1c2e78e6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:37.999006 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c628e1-364a-485a-afb0-1fc1c2e78e6d None admin] RBAC: Adding query filter params (role.id=669c23212b4843c8900c3d2e58fb6e0f, user.id=3655018d6ade4aa4a0d76533534eb8db, scope.system=all) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:37.999360 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c628e1-364a-485a-afb0-1fc1c2e78e6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:38.000835 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c628e1-364a-485a-afb0-1fc1c2e78e6d None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:38.013596 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 166/334] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Jul 14 12:49:37 2022] GET /identity/v3/role_assignments?user.id=3655018d6ade4aa4a0d76533534eb8db&scope.system=all&role.id=669c23212b4843c8900c3d2e58fb6e0f => generated 510 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:40.276278 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c4628-bcc4-46e4-9d77-14f3294dacd0 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:40.276820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c4628-bcc4-46e4-9d77-14f3294dacd0 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:40.276921 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6c4628-bcc4-46e4-9d77-14f3294dacd0 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:40.278262 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 169/335] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:40.284430 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9c2aa-e198-4019-9608-bd96d8b96a79 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:40.285193 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9c2aa-e198-4019-9608-bd96d8b96a79 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:40.285193 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e9c2aa-e198-4019-9608-bd96d8b96a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:40.302412 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3283f48-9407-41c6-a73a-52860ab0b562 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:40.302724 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3283f48-9407-41c6-a73a-52860ab0b562 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:40.302958 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3283f48-9407-41c6-a73a-52860ab0b562 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:40.304612 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 170/336] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:40.307096 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-b4e9c2aa-e198-4019-9608-bd96d8b96a79 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:40.308316 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-b4e9c2aa-e198-4019-9608-bd96d8b96a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:40.309948 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca464705-5a9e-477b-b907-b67eacc6fab4 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:40.310240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca464705-5a9e-477b-b907-b67eacc6fab4 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:40.310515 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca464705-5a9e-477b-b907-b67eacc6fab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:40.337942 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:40.345742 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-ca464705-5a9e-477b-b907-b67eacc6fab4 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:40.346966 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-ca464705-5a9e-477b-b907-b67eacc6fab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:40.398161 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 167/337] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:40.399434 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1e1a7-1961-4513-ada3-f04259ca8de7 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:40.399828 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1e1a7-1961-4513-ada3-f04259ca8de7 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:40.400120 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e1e1a7-1961-4513-ada3-f04259ca8de7 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:40.401684 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 168/338] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:40.409511 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21858697-0644-47e4-bde1-3c166441a4bc None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:40.409806 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21858697-0644-47e4-bde1-3c166441a4bc None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:40.410094 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21858697-0644-47e4-bde1-3c166441a4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:40.430100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-21858697-0644-47e4-bde1-3c166441a4bc None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:40.431325 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-21858697-0644-47e4-bde1-3c166441a4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:40.513814 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:40.530249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 171/339] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:40.532095 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca464705-5a9e-477b-b907-b67eacc6fab4 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:40.537709 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 169/340] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:40.566367 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21858697-0644-47e4-bde1-3c166441a4bc None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:40.679505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca464705-5a9e-477b-b907-b67eacc6fab4 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:40.722337 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fdf7f-9573-4517-bb16-05e16b188f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:40.723147 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fdf7f-9573-4517-bb16-05e16b188f13 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:40.723430 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fdf7f-9573-4517-bb16-05e16b188f13 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:40.723703 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62fdf7f-9573-4517-bb16-05e16b188f13 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:40.724647 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:40.738372 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62fdf7f-9573-4517-bb16-05e16b188f13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:40.756162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-a62fdf7f-9573-4517-bb16-05e16b188f13 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:40.756162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:40.756162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:40.756162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:40.756162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:40.756162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:40.756162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:40.756162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:40.756162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:40.756162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:40.756162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:40.756162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:40.756162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:40.756162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:40.756162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:40.756162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:40.757218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:40.757218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:40.757218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:40.757218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:40.757218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:40.757218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:40.757218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:40.757218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:40.757218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:40.757218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:40.757218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:40.757218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:40.757218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:40.757218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:40.757218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:40.757218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:40.758007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:40.758007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:40.758007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:40.758007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:40.758007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:40.758007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:40.758007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:40.758007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:40.758007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:40.758007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:40.758007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:40.758007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:40.764280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 172/341] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:40.764280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fdf7f-9573-4517-bb16-05e16b188f13 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:40.777477 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21858697-0644-47e4-bde1-3c166441a4bc None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:40.852228 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e05ea-35e8-4eec-8712-d3843fdbd69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:40.853537 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e05ea-35e8-4eec-8712-d3843fdbd69f None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:40.853814 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e05ea-35e8-4eec-8712-d3843fdbd69f None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:40.854086 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e05ea-35e8-4eec-8712-d3843fdbd69f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:40.877103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:40.880419 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2e05ea-35e8-4eec-8712-d3843fdbd69f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:40.888348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-da2e05ea-35e8-4eec-8712-d3843fdbd69f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 12:49:40.888348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:40.888348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:40.888348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:40.888348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:40.888348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:40.888348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:40.888348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:40.888348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:40.888348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:40.888348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:40.888348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:40.888348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:40.888348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:40.888348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:40.888348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:40.890966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:40.890966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:40.890966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:40.890966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:40.890966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:40.890966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:40.890966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:40.890966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:40.890966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:40.890966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:40.890966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:40.890966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:40.890966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:40.890966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:40.890966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:40.890966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:40.893007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:40.893007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:40.893007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:40.893007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:40.893007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:40.893007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:40.893007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:40.893007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:40.893007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:40.893007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:40.893007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 14 12:49:40.893007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:40.900657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 170/342] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:40.900657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e05ea-35e8-4eec-8712-d3843fdbd69f None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:40.938011 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62fdf7f-9573-4517-bb16-05e16b188f13 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:40.982594 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0501e7-ab6f-4127-bbee-21c3dbe9227a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:40.983432 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0501e7-ab6f-4127-bbee-21c3dbe9227a None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:40.983743 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0501e7-ab6f-4127-bbee-21c3dbe9227a None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:40.984026 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0501e7-ab6f-4127-bbee-21c3dbe9227a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:41.015518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0501e7-ab6f-4127-bbee-21c3dbe9227a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:41.034905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-6f0501e7-ab6f-4127-bbee-21c3dbe9227a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:41.034905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:41.034905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:41.034905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:41.034905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:41.034905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:41.034905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:41.034905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:41.034905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:41.034905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:41.034905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:41.034905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:41.034905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:41.034905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:41.034905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:41.034905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:41.037103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:41.037103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:41.037103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:41.037103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:41.037103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:41.037103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:41.037103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:41.037103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:41.037103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:41.037103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:41.037103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:41.037103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:41.037103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:41.037103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:41.037103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:41.037103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:41.038720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:41.038720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:41.038720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:41.038720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:41.038720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:41.038720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:41.038720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:41.038720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:41.038720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:41.038720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:41.038720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:41.038720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:41.038720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 173/343] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:49:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:41.043879 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0501e7-ab6f-4127-bbee-21c3dbe9227a None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:41.140561 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e05ea-35e8-4eec-8712-d3843fdbd69f None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:41.173379 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dec57-53ac-407b-bf12-f4385c0a1bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:41.174065 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dec57-53ac-407b-bf12-f4385c0a1bd6 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:41.174345 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dec57-53ac-407b-bf12-f4385c0a1bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:41.174623 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2dec57-53ac-407b-bf12-f4385c0a1bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:41.175379 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dec57-53ac-407b-bf12-f4385c0a1bd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:41.175684 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dec57-53ac-407b-bf12-f4385c0a1bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:41.177272 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2dec57-53ac-407b-bf12-f4385c0a1bd6 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:41.189245 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:41.194127 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 171/344] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:41.195020 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dec57-53ac-407b-bf12-f4385c0a1bd6 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:41.221295 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0501e7-ab6f-4127-bbee-21c3dbe9227a None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:41.235025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:41.260767 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30adaa-ecb2-47d0-b335-cf700d7695dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:41.261447 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30adaa-ecb2-47d0-b335-cf700d7695dd None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:41.261735 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30adaa-ecb2-47d0-b335-cf700d7695dd None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:41.262016 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a30adaa-ecb2-47d0-b335-cf700d7695dd None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:41.262777 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30adaa-ecb2-47d0-b335-cf700d7695dd None admin] RBAC: Adding query filter params (name=reader) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:41.263086 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30adaa-ecb2-47d0-b335-cf700d7695dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:41.264508 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a30adaa-ecb2-47d0-b335-cf700d7695dd None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:41.280268 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 174/345] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:41.282228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30adaa-ecb2-47d0-b335-cf700d7695dd None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:41.327609 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2dec57-53ac-407b-bf12-f4385c0a1bd6 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:41.364936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab564c37-aa24-4b56-abb5-f340810e0c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:41.365608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab564c37-aa24-4b56-abb5-f340810e0c65 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:41.365889 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab564c37-aa24-4b56-abb5-f340810e0c65 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:41.366162 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab564c37-aa24-4b56-abb5-f340810e0c65 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:41.366905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab564c37-aa24-4b56-abb5-f340810e0c65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:41.367206 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab564c37-aa24-4b56-abb5-f340810e0c65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:41.368583 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab564c37-aa24-4b56-abb5-f340810e0c65 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:41.378126 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 172/346] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:49:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:41.379582 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc17497-ebfe-44cb-8c4d-93e2b85cd5eb None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:41.379878 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc17497-ebfe-44cb-8c4d-93e2b85cd5eb None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:41.380154 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc17497-ebfe-44cb-8c4d-93e2b85cd5eb None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:41.383828 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 173/347] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:41.384370 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc17497-ebfe-44cb-8c4d-93e2b85cd5eb None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:41.390379 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a30adaa-ecb2-47d0-b335-cf700d7695dd None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:41.430001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5d70b-d7b2-44f7-8aae-1b518d7b524b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:41.430805 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5d70b-d7b2-44f7-8aae-1b518d7b524b None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:41.431094 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5d70b-d7b2-44f7-8aae-1b518d7b524b None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:41.431375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5d70b-d7b2-44f7-8aae-1b518d7b524b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:41.464436 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:41.482165 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:41.508821 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc17497-ebfe-44cb-8c4d-93e2b85cd5eb None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:41.510281 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5d70b-d7b2-44f7-8aae-1b518d7b524b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:41.511785 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5d70b-d7b2-44f7-8aae-1b518d7b524b None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:41.546176 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbf2af-090f-409b-99de-4b01d650618d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:41.548031 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbf2af-090f-409b-99de-4b01d650618d None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:41.548326 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbf2af-090f-409b-99de-4b01d650618d None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:41.548607 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbf2af-090f-409b-99de-4b01d650618d None admin] PATH_INFO: `/v3/users/5698171a43b24b24aa64a078b8392687` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:41.550040 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbf2af-090f-409b-99de-4b01d650618d None admin] RBAC: Authorizing `identity:get_user(user_id=5698171a43b24b24aa64a078b8392687)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:41.551508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbf2af-090f-409b-99de-4b01d650618d None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:41.553568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 174/348] 10.222.0.40 () {56 vars in 1177 bytes} [Thu Jul 14 12:49:41 2022] GET /identity/v3/users/5698171a43b24b24aa64a078b8392687 => generated 293 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:41.554354 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbf2af-090f-409b-99de-4b01d650618d None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:41.642849 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 175/349] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:41.644154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3ba70-2162-4ae9-b6de-88220569d551 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:41.644443 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3ba70-2162-4ae9-b6de-88220569d551 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:41.644762 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3ba70-2162-4ae9-b6de-88220569d551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:41.661790 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-ebe3ba70-2162-4ae9-b6de-88220569d551 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:41.662994 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-ebe3ba70-2162-4ae9-b6de-88220569d551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:41.693092 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbf2af-090f-409b-99de-4b01d650618d None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:41.730328 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:41.743179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b361182-9fb7-46c0-add4-cd6ca99a1d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:41.743836 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b361182-9fb7-46c0-add4-cd6ca99a1d22 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:41.744122 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b361182-9fb7-46c0-add4-cd6ca99a1d22 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:41.744499 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b361182-9fb7-46c0-add4-cd6ca99a1d22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:41.756659 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 176/350] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:41.756659 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3ba70-2162-4ae9-b6de-88220569d551 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:41.756659 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:41.852193 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b361182-9fb7-46c0-add4-cd6ca99a1d22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:41.854082 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b361182-9fb7-46c0-add4-cd6ca99a1d22 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:41.878459 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3ba70-2162-4ae9-b6de-88220569d551 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:41.930170 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d81433-4c6a-4323-aa77-7ea51cfa6eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:41.931040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d81433-4c6a-4323-aa77-7ea51cfa6eed None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:41.931294 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d81433-4c6a-4323-aa77-7ea51cfa6eed None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:41.931934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d81433-4c6a-4323-aa77-7ea51cfa6eed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:41.932456 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d81433-4c6a-4323-aa77-7ea51cfa6eed None admin] RBAC: Adding query filter params (role.id=c3cd9bef86d3428c8b7a2914eb37e097, user.id=5698171a43b24b24aa64a078b8392687, scope.system=all) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:41.932830 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d81433-4c6a-4323-aa77-7ea51cfa6eed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:41.934299 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d81433-4c6a-4323-aa77-7ea51cfa6eed None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:41.949501 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 177/351] 10.222.0.40 () {56 vars in 1308 bytes} [Thu Jul 14 12:49:41 2022] GET /identity/v3/role_assignments?user.id=5698171a43b24b24aa64a078b8392687&scope.system=all&role.id=c3cd9bef86d3428c8b7a2914eb37e097 => generated 510 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:41.950963 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2ab9e-9aef-46b0-bfb1-5379c62f5638 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:41.951261 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2ab9e-9aef-46b0-bfb1-5379c62f5638 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:41.951540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2ab9e-9aef-46b0-bfb1-5379c62f5638 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:41.953444 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 178/352] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:41.954167 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2ab9e-9aef-46b0-bfb1-5379c62f5638 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:42.023689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 175/353] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:42.024851 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b361182-9fb7-46c0-add4-cd6ca99a1d22 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:42.043718 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:42.068688 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:42.093091 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2ab9e-9aef-46b0-bfb1-5379c62f5638 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:42.145978 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f9d99c-c62e-43e7-b110-e093e82962a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:42.150071 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9d99c-c62e-43e7-b110-e093e82962a4 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:42.150071 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9d99c-c62e-43e7-b110-e093e82962a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:42.150071 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9d99c-c62e-43e7-b110-e093e82962a4 None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:42.150799 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9d99c-c62e-43e7-b110-e093e82962a4 None admin] RBAC: Authorizing `identity:get_project(project_id=5c24e2362747458280e0394abcfd13a3)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:42.152282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f9d99c-c62e-43e7-b110-e093e82962a4 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:42.156565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 179/354] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:41 2022] GET /identity/v3/projects/5c24e2362747458280e0394abcfd13a3 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:42.156565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37204c4-2b07-4ae3-88d0-3caa70e1f398 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:42.156565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37204c4-2b07-4ae3-88d0-3caa70e1f398 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:42.156565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37204c4-2b07-4ae3-88d0-3caa70e1f398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:42.173814 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-c37204c4-2b07-4ae3-88d0-3caa70e1f398 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:42.175086 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-c37204c4-2b07-4ae3-88d0-3caa70e1f398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:42.178008 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b361182-9fb7-46c0-add4-cd6ca99a1d22 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:42.231486 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12409959-5ecd-4057-afc3-1345f11a5888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:42.232312 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409959-5ecd-4057-afc3-1345f11a5888 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:42.232599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409959-5ecd-4057-afc3-1345f11a5888 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:42.232915 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12409959-5ecd-4057-afc3-1345f11a5888 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:42.248544 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12409959-5ecd-4057-afc3-1345f11a5888 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:42.257100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-12409959-5ecd-4057-afc3-1345f11a5888 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:42.257100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:42.257100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:42.257100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:42.257100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:42.257100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:42.257100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:42.257100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:42.257100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:42.257100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:42.257100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:42.257100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:42.257100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:42.257100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:42.257100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:42.257100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:42.258019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:42.258019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:42.258019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:42.258019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:42.258019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:42.258019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:42.258019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:42.258019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:42.258019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:42.258019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:42.258019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:42.258019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:42.258019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:42.258019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:42.258019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:42.258019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:42.258812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:42.258812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:42.258812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:42.258812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:42.258812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:42.258812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:42.258812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:42.258812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:42.258812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:42.258812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:42.258812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:42.258812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:42.258812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 176/355] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:42.259460 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12409959-5ecd-4057-afc3-1345f11a5888 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:42.271118 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 180/356] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:42.273126 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f9df8-f19e-4809-b877-7e9d0365d726 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:42.273472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f9df8-f19e-4809-b877-7e9d0365d726 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:42.273797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6f9df8-f19e-4809-b877-7e9d0365d726 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:42.275398 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 181/357] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:42.275992 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f9df8-f19e-4809-b877-7e9d0365d726 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:42.349831 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:42.373433 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:42.386347 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12409959-5ecd-4057-afc3-1345f11a5888 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:42.408751 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6f9df8-f19e-4809-b877-7e9d0365d726 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:42.426292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf596d86-c0a5-46f1-8916-622f6211093a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:42.427461 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf596d86-c0a5-46f1-8916-622f6211093a None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:42.427917 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf596d86-c0a5-46f1-8916-622f6211093a None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:42.428200 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf596d86-c0a5-46f1-8916-622f6211093a None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:42.429858 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf596d86-c0a5-46f1-8916-622f6211093a None admin] RBAC: Authorizing `identity:get_project(project_id=5c24e2362747458280e0394abcfd13a3)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:42.431373 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf596d86-c0a5-46f1-8916-622f6211093a None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:42.433462 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 177/358] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:42 2022] GET /identity/v3/projects/5c24e2362747458280e0394abcfd13a3 => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:42.434772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf596d86-c0a5-46f1-8916-622f6211093a None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:42.451580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecce6ae-c958-4589-a3a7-b8dd0c58ccfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:42.452663 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecce6ae-c958-4589-a3a7-b8dd0c58ccfa None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:42.453093 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecce6ae-c958-4589-a3a7-b8dd0c58ccfa None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:42.453460 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecce6ae-c958-4589-a3a7-b8dd0c58ccfa None admin] PATH_INFO: `/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:42.460870 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecce6ae-c958-4589-a3a7-b8dd0c58ccfa None admin] RBAC: Authorizing `identity:get_group(group_id=7f3f0a93ed3849b2be01e7df3dfa0828)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:42.511004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecce6ae-c958-4589-a3a7-b8dd0c58ccfa None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:42.511004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 182/359] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 12:49:42 2022] GET /identity/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:42.511004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7013818-443c-4bb1-a5b3-74fee82eec26 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:42.511004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7013818-443c-4bb1-a5b3-74fee82eec26 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:42.511004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7013818-443c-4bb1-a5b3-74fee82eec26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:42.511004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-c7013818-443c-4bb1-a5b3-74fee82eec26 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:42.511482 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-c7013818-443c-4bb1-a5b3-74fee82eec26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:42.573950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf596d86-c0a5-46f1-8916-622f6211093a None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:42.580400 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 183/360] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:42.581121 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7013818-443c-4bb1-a5b3-74fee82eec26 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:42.617321 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3106417-d062-4109-b98f-3e2226e28a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:42.617996 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3106417-d062-4109-b98f-3e2226e28a8d None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:42.618283 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3106417-d062-4109-b98f-3e2226e28a8d None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:42.618565 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3106417-d062-4109-b98f-3e2226e28a8d None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:42.619325 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3106417-d062-4109-b98f-3e2226e28a8d None admin] RBAC: Adding query filter params (name=member) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:42.619648 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3106417-d062-4109-b98f-3e2226e28a8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:42.621082 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3106417-d062-4109-b98f-3e2226e28a8d None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:42.634224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 178/361] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:42.635512 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3106417-d062-4109-b98f-3e2226e28a8d None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:42.653691 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:42.662433 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:42.707565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7013818-443c-4bb1-a5b3-74fee82eec26 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:42.750685 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a01f71-d48f-4c0c-b6ec-902fd7774f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:42.756759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a01f71-d48f-4c0c-b6ec-902fd7774f28 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:42.756759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a01f71-d48f-4c0c-b6ec-902fd7774f28 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:42.756759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a01f71-d48f-4c0c-b6ec-902fd7774f28 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:42.757031 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3106417-d062-4109-b98f-3e2226e28a8d None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:42.765609 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a01f71-d48f-4c0c-b6ec-902fd7774f28 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:42.775376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-79a01f71-d48f-4c0c-b6ec-902fd7774f28 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:42.775376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:42.775376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:42.775376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:42.775376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:42.775376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:42.775376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:42.775376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:42.775376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:42.775376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:42.775376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:42.775376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:42.775376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:42.775376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:42.775376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:42.775376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:42.776454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:42.776454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:42.776454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:42.776454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:42.776454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:42.776454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:42.776454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:42.776454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:42.776454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:42.776454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:42.776454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:42.776454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:42.776454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:42.776454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:42.776454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:42.776454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:42.777354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:42.777354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:42.777354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:42.777354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:42.777354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:42.777354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:42.777354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:42.777354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:42.777354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:42.777354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:42.777354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:42.777354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:42.777354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 184/362] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:49:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:42.778080 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a01f71-d48f-4c0c-b6ec-902fd7774f28 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:42.800207 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f6ab0-fbda-463c-8047-60cab261ddf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:42.801129 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6ab0-fbda-463c-8047-60cab261ddf1 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:42.801410 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6ab0-fbda-463c-8047-60cab261ddf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:42.802013 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00f6ab0-fbda-463c-8047-60cab261ddf1 None admin] PATH_INFO: `/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:42.803903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f6ab0-fbda-463c-8047-60cab261ddf1 None admin] RBAC: Authorizing `identity:get_group(group_id=7f3f0a93ed3849b2be01e7df3dfa0828)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:42.807693 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00f6ab0-fbda-463c-8047-60cab261ddf1 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:42.807693 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 179/363] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 12:49:42 2022] GET /identity/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:42.814626 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f6ab0-fbda-463c-8047-60cab261ddf1 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:42.914885 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a01f71-d48f-4c0c-b6ec-902fd7774f28 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:42.927351 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:42.929754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:42.941873 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00f6ab0-fbda-463c-8047-60cab261ddf1 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:42.956901 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f980b07-b1f7-42a2-8c66-8a2b3d079fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:42.957568 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f980b07-b1f7-42a2-8c66-8a2b3d079fe2 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:42.958461 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f980b07-b1f7-42a2-8c66-8a2b3d079fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:42.958939 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f980b07-b1f7-42a2-8c66-8a2b3d079fe2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:42.959974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f980b07-b1f7-42a2-8c66-8a2b3d079fe2 None admin] RBAC: Adding query filter params (group.id=7f3f0a93ed3849b2be01e7df3dfa0828, role.id=669c23212b4843c8900c3d2e58fb6e0f, scope.project.id=5c24e2362747458280e0394abcfd13a3) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:42.960280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f980b07-b1f7-42a2-8c66-8a2b3d079fe2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:42.961810 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f980b07-b1f7-42a2-8c66-8a2b3d079fe2 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:42.969037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 185/364] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 12:49:42 2022] GET /identity/v3/role_assignments?group.id=7f3f0a93ed3849b2be01e7df3dfa0828&scope.project.id=5c24e2362747458280e0394abcfd13a3&role.id=669c23212b4843c8900c3d2e58fb6e0f => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:42.969881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f980b07-b1f7-42a2-8c66-8a2b3d079fe2 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:42.991007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efda5a-5608-4962-913a-90d94e144de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:42.991817 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efda5a-5608-4962-913a-90d94e144de5 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:42.992106 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efda5a-5608-4962-913a-90d94e144de5 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:42.992408 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9efda5a-5608-4962-913a-90d94e144de5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:43.010179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9efda5a-5608-4962-913a-90d94e144de5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:43.018699 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-d9efda5a-5608-4962-913a-90d94e144de5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:49:43.018699 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:43.018699 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:43.018699 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:43.018699 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:43.018699 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:43.018699 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:43.018699 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:43.018699 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:43.018699 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:43.018699 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:43.018699 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:43.018699 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:43.018699 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:43.018699 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:43.018699 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:43.019882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:43.019882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:43.019882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:43.019882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:43.019882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:43.019882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:43.019882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:43.019882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:43.019882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:43.019882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:43.019882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:43.019882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:43.019882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:43.019882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:43.019882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:43.019882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:43.020880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:43.020880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:43.020880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:43.020880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:43.020880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:43.020880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:43.020880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:43.020880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:43.020880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:43.020880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:43.020880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:49:43.020880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:43.020880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 180/365] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 12:49:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:43.020880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efda5a-5608-4962-913a-90d94e144de5 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:43.142093 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f980b07-b1f7-42a2-8c66-8a2b3d079fe2 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:43.171412 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9efda5a-5608-4962-913a-90d94e144de5 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:43.192093 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3faf0a-8738-42bf-80fd-1aa583ba3c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:43.193907 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3faf0a-8738-42bf-80fd-1aa583ba3c73 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:43.194202 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3faf0a-8738-42bf-80fd-1aa583ba3c73 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:43.194482 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3faf0a-8738-42bf-80fd-1aa583ba3c73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:43.218778 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8648488-e851-4274-9208-13424c95c90a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:43.219445 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8648488-e851-4274-9208-13424c95c90a None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:43.219729 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8648488-e851-4274-9208-13424c95c90a None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:43.220008 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8648488-e851-4274-9208-13424c95c90a None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:43.220793 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8648488-e851-4274-9208-13424c95c90a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:43.221100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8648488-e851-4274-9208-13424c95c90a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:43.222471 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8648488-e851-4274-9208-13424c95c90a None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:43.238583 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 181/366] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:49:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:43.239503 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8648488-e851-4274-9208-13424c95c90a None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:43.253213 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:43.263709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:43.297186 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3faf0a-8738-42bf-80fd-1aa583ba3c73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:43.300132 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3faf0a-8738-42bf-80fd-1aa583ba3c73 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:43.367243 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8648488-e851-4274-9208-13424c95c90a None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:43.412579 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6c066-d2c2-4af7-95bb-7f7fb6f5cbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:43.414153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6c066-d2c2-4af7-95bb-7f7fb6f5cbf6 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:43.414436 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6c066-d2c2-4af7-95bb-7f7fb6f5cbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:43.414709 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b6c066-d2c2-4af7-95bb-7f7fb6f5cbf6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:43.415544 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6c066-d2c2-4af7-95bb-7f7fb6f5cbf6 None admin] RBAC: Adding query filter params (group.id=7f3f0a93ed3849b2be01e7df3dfa0828, role.id=4c8541aa8143464aa29696e1d957e9b5, scope.project.id=5c24e2362747458280e0394abcfd13a3) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:43.415962 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6c066-d2c2-4af7-95bb-7f7fb6f5cbf6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:43.419299 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b6c066-d2c2-4af7-95bb-7f7fb6f5cbf6 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:43.426391 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 182/367] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 12:49:43 2022] GET /identity/v3/role_assignments?group.id=7f3f0a93ed3849b2be01e7df3dfa0828&scope.project.id=5c24e2362747458280e0394abcfd13a3&role.id=4c8541aa8143464aa29696e1d957e9b5 => generated 260 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:43.427000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6c066-d2c2-4af7-95bb-7f7fb6f5cbf6 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:43.442307 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 186/368] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:43.442307 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3faf0a-8738-42bf-80fd-1aa583ba3c73 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:43.537400 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:43.556179 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:43.573668 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b6c066-d2c2-4af7-95bb-7f7fb6f5cbf6 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:43.590141 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3faf0a-8738-42bf-80fd-1aa583ba3c73 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:43.624498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26cfa7-c88e-4293-a032-e6e0beaa3955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:43.626111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26cfa7-c88e-4293-a032-e6e0beaa3955 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:43.626891 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26cfa7-c88e-4293-a032-e6e0beaa3955 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:43.627402 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26cfa7-c88e-4293-a032-e6e0beaa3955 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:43.628990 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26cfa7-c88e-4293-a032-e6e0beaa3955 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:43.629770 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26cfa7-c88e-4293-a032-e6e0beaa3955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:43.631575 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26cfa7-c88e-4293-a032-e6e0beaa3955 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:43.634144 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f90139-5218-4cc1-9bca-5583b882a6f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:43.635417 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f90139-5218-4cc1-9bca-5583b882a6f7 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:43.635524 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f90139-5218-4cc1-9bca-5583b882a6f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:43.635718 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f90139-5218-4cc1-9bca-5583b882a6f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:43.643328 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 183/369] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:43.643499 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26cfa7-c88e-4293-a032-e6e0beaa3955 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:43.729978 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f90139-5218-4cc1-9bca-5583b882a6f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:43.731375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f90139-5218-4cc1-9bca-5583b882a6f7 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:43.786157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26cfa7-c88e-4293-a032-e6e0beaa3955 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:43.830361 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:43.836214 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0ab81-3c7b-4ef6-a2e3-f2eb7794f501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:43.837631 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0ab81-3c7b-4ef6-a2e3-f2eb7794f501 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:43.838297 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0ab81-3c7b-4ef6-a2e3-f2eb7794f501 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:43.838791 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a0ab81-3c7b-4ef6-a2e3-f2eb7794f501 None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:43.841182 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0ab81-3c7b-4ef6-a2e3-f2eb7794f501 None admin] RBAC: Authorizing `identity:get_project(project_id=4939ee9d222341dca515aa1fa4cff0d1)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:43.842810 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a0ab81-3c7b-4ef6-a2e3-f2eb7794f501 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:43.845907 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 184/370] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:43 2022] GET /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1 => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:43.847115 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0ab81-3c7b-4ef6-a2e3-f2eb7794f501 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:43.851745 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:43.864914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 187/371] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:43.865970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f90139-5218-4cc1-9bca-5583b882a6f7 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:43.988185 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a0ab81-3c7b-4ef6-a2e3-f2eb7794f501 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:44.007816 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f90139-5218-4cc1-9bca-5583b882a6f7 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:44.031710 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c28fa2-57de-4485-9aca-c4628688c3ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:44.032471 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c28fa2-57de-4485-9aca-c4628688c3ca None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:44.032861 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c28fa2-57de-4485-9aca-c4628688c3ca None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:44.033300 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c28fa2-57de-4485-9aca-c4628688c3ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:44.044848 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce1f23-8d2e-4e13-ac6c-38d3ed93dc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:44.045714 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce1f23-8d2e-4e13-ac6c-38d3ed93dc0a None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:44.046038 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce1f23-8d2e-4e13-ac6c-38d3ed93dc0a None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:44.046322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce1f23-8d2e-4e13-ac6c-38d3ed93dc0a None admin] PATH_INFO: `/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:44.048519 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce1f23-8d2e-4e13-ac6c-38d3ed93dc0a None admin] RBAC: Authorizing `identity:get_group(group_id=7f3f0a93ed3849b2be01e7df3dfa0828)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:44.050016 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ce1f23-8d2e-4e13-ac6c-38d3ed93dc0a None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:44.056599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 188/372] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 12:49:43 2022] GET /identity/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:44.057534 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce1f23-8d2e-4e13-ac6c-38d3ed93dc0a None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:44.108326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:44.117067 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c28fa2-57de-4485-9aca-c4628688c3ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:44.118969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c28fa2-57de-4485-9aca-c4628688c3ca None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:44.122168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:44.168491 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce1f23-8d2e-4e13-ac6c-38d3ed93dc0a None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:44.210566 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ced28-c3f0-43ae-9d11-d2bdce28dcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:44.211435 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ced28-c3f0-43ae-9d11-d2bdce28dcb3 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:44.211716 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ced28-c3f0-43ae-9d11-d2bdce28dcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:44.211990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6ced28-c3f0-43ae-9d11-d2bdce28dcb3 None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:44.213243 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ced28-c3f0-43ae-9d11-d2bdce28dcb3 None admin] RBAC: Authorizing `identity:get_project(project_id=4939ee9d222341dca515aa1fa4cff0d1)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:44.215013 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6ced28-c3f0-43ae-9d11-d2bdce28dcb3 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:44.220676 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 189/373] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:44 2022] GET /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:44.220676 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ced28-c3f0-43ae-9d11-d2bdce28dcb3 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:44.263140 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 185/374] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:44.269198 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c28fa2-57de-4485-9aca-c4628688c3ca None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:44.345368 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6ced28-c3f0-43ae-9d11-d2bdce28dcb3 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:44.363799 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:44.388030 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359dfca-a7d5-4be5-92c7-cac1d4904586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:44.388714 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359dfca-a7d5-4be5-92c7-cac1d4904586 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:44.389002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359dfca-a7d5-4be5-92c7-cac1d4904586 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:44.389275 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7359dfca-a7d5-4be5-92c7-cac1d4904586 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:44.390148 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359dfca-a7d5-4be5-92c7-cac1d4904586 None admin] RBAC: Adding query filter params (group.id=7f3f0a93ed3849b2be01e7df3dfa0828, role.id=669c23212b4843c8900c3d2e58fb6e0f, scope.project.id=4939ee9d222341dca515aa1fa4cff0d1) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:44.390459 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359dfca-a7d5-4be5-92c7-cac1d4904586 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:44.390796 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c28fa2-57de-4485-9aca-c4628688c3ca None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:44.392273 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7359dfca-a7d5-4be5-92c7-cac1d4904586 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:44.393908 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:44.399411 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 190/375] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 12:49:44 2022] GET /identity/v3/role_assignments?group.id=7f3f0a93ed3849b2be01e7df3dfa0828&scope.project.id=4939ee9d222341dca515aa1fa4cff0d1&role.id=669c23212b4843c8900c3d2e58fb6e0f => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:44.401481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359dfca-a7d5-4be5-92c7-cac1d4904586 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:44.463720 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016774c-3717-43d1-970f-4f2185e9ae35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:44.465491 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016774c-3717-43d1-970f-4f2185e9ae35 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:44.466607 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016774c-3717-43d1-970f-4f2185e9ae35 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:44.467223 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6016774c-3717-43d1-970f-4f2185e9ae35 None admin] PATH_INFO: `/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:44.471115 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016774c-3717-43d1-970f-4f2185e9ae35 None admin] RBAC: Authorizing `identity:get_group(group_id=7f3f0a93ed3849b2be01e7df3dfa0828)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:44.473458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6016774c-3717-43d1-970f-4f2185e9ae35 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:44.476303 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 186/376] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 12:49:44 2022] GET /identity/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828 => generated 226 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:44.482496 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016774c-3717-43d1-970f-4f2185e9ae35 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:44.601381 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7359dfca-a7d5-4be5-92c7-cac1d4904586 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:44.651005 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b626db7-ab23-4d12-88cb-6ae495b3cf35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:44.652732 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b626db7-ab23-4d12-88cb-6ae495b3cf35 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:44.653567 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b626db7-ab23-4d12-88cb-6ae495b3cf35 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:44.654186 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b626db7-ab23-4d12-88cb-6ae495b3cf35 None admin] PATH_INFO: `/v3/projects/c24ba159095c44f2835516dff526567e` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:44.656306 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b626db7-ab23-4d12-88cb-6ae495b3cf35 None admin] RBAC: Authorizing `identity:get_project(project_id=c24ba159095c44f2835516dff526567e)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:44.658953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b626db7-ab23-4d12-88cb-6ae495b3cf35 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:44.661282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 191/377] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:44 2022] GET /identity/v3/projects/c24ba159095c44f2835516dff526567e => generated 344 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:44.670549 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b626db7-ab23-4d12-88cb-6ae495b3cf35 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:44.685842 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6016774c-3717-43d1-970f-4f2185e9ae35 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:44.732446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84781f4c-d7d2-4dc9-a7d4-aa2fa195bc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:44.733415 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84781f4c-d7d2-4dc9-a7d4-aa2fa195bc7d None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:44.736143 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84781f4c-d7d2-4dc9-a7d4-aa2fa195bc7d None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:44.736587 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84781f4c-d7d2-4dc9-a7d4-aa2fa195bc7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:44.737637 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84781f4c-d7d2-4dc9-a7d4-aa2fa195bc7d None admin] RBAC: Adding query filter params (group.id=7f3f0a93ed3849b2be01e7df3dfa0828, role.id=4c8541aa8143464aa29696e1d957e9b5, scope.project.id=4939ee9d222341dca515aa1fa4cff0d1) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:44.739147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84781f4c-d7d2-4dc9-a7d4-aa2fa195bc7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:44.740856 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84781f4c-d7d2-4dc9-a7d4-aa2fa195bc7d None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:44.747893 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 187/378] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 12:49:44 2022] GET /identity/v3/role_assignments?group.id=7f3f0a93ed3849b2be01e7df3dfa0828&scope.project.id=4939ee9d222341dca515aa1fa4cff0d1&role.id=4c8541aa8143464aa29696e1d957e9b5 => generated 260 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:44.767116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:44.832500 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b626db7-ab23-4d12-88cb-6ae495b3cf35 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:44.882869 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194179a8-0f5f-44ac-b71a-b78acf6e8044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:44.883662 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194179a8-0f5f-44ac-b71a-b78acf6e8044 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:44.883939 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194179a8-0f5f-44ac-b71a-b78acf6e8044 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:44.884212 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194179a8-0f5f-44ac-b71a-b78acf6e8044 None admin] PATH_INFO: `/v3/groups/280441d4a7ed448bb65e2395d74ed939` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:44.894091 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194179a8-0f5f-44ac-b71a-b78acf6e8044 None admin] RBAC: Authorizing `identity:get_group(group_id=280441d4a7ed448bb65e2395d74ed939)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:44.895573 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194179a8-0f5f-44ac-b71a-b78acf6e8044 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:44.897639 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 192/379] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 12:49:44 2022] GET /identity/v3/groups/280441d4a7ed448bb65e2395d74ed939 => generated 229 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:44.903424 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84781f4c-d7d2-4dc9-a7d4-aa2fa195bc7d None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:44.966471 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:45.046222 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84781f4c-d7d2-4dc9-a7d4-aa2fa195bc7d None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:45.084017 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f394cd9-e243-40b0-862e-1f74c117e3df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:45.084701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f394cd9-e243-40b0-862e-1f74c117e3df None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:45.084987 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f394cd9-e243-40b0-862e-1f74c117e3df None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:45.085261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f394cd9-e243-40b0-862e-1f74c117e3df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:45.086082 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f394cd9-e243-40b0-862e-1f74c117e3df None admin] RBAC: Adding query filter params (group.id=280441d4a7ed448bb65e2395d74ed939, role.id=9bca71f77ac24a898d3445ab3c205809, scope.project.id=c24ba159095c44f2835516dff526567e) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:45.086391 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f394cd9-e243-40b0-862e-1f74c117e3df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:45.087813 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f394cd9-e243-40b0-862e-1f74c117e3df None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:45.094059 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 188/380] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 12:49:44 2022] GET /identity/v3/role_assignments?group.id=280441d4a7ed448bb65e2395d74ed939&scope.project.id=c24ba159095c44f2835516dff526567e&role.id=9bca71f77ac24a898d3445ab3c205809 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:45.446559 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67649068-d1ee-43fc-b82e-2efe311954c3 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:45.446863 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67649068-d1ee-43fc-b82e-2efe311954c3 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:45.447152 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67649068-d1ee-43fc-b82e-2efe311954c3 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:45.448742 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 193/381] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:45.454389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2c479-37d4-45ca-978f-d40d91e169ea None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:45.454679 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2c479-37d4-45ca-978f-d40d91e169ea None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:45.454962 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2c479-37d4-45ca-978f-d40d91e169ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:45.473179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-c4a2c479-37d4-45ca-978f-d40d91e169ea None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:45.474389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-c4a2c479-37d4-45ca-978f-d40d91e169ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:45.547499 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 189/382] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:45.584085 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67649068-d1ee-43fc-b82e-2efe311954c3 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:45.728786 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67649068-d1ee-43fc-b82e-2efe311954c3 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:45.746243 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:45.782394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1547fee-717c-4150-bca4-48c789dad05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:45.783554 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1547fee-717c-4150-bca4-48c789dad05f None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:45.784056 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1547fee-717c-4150-bca4-48c789dad05f None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:45.784523 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1547fee-717c-4150-bca4-48c789dad05f None admin] PATH_INFO: `/v3/roles/member` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:45.802707 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1547fee-717c-4150-bca4-48c789dad05f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:45.810934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-d1547fee-717c-4150-bca4-48c789dad05f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:45.810934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:45.810934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:45.810934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:45.810934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:45.810934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:45.810934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:45.810934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:45.810934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:45.810934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:45.810934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:45.810934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:45.810934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:45.810934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:45.810934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:45.810934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:45.812366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:45.812366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:45.812366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:45.812366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:45.812366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:45.812366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:45.812366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:45.812366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:45.812366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:45.812366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:45.812366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:45.812366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:45.812366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:45.812366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:45.812366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:45.812366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:45.817565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:45.817565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:45.817565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:45.817565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:45.817565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:45.817565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:45.817565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:45.817565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:45.817565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:45.817565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:45.817565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:45.817565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:45.820120 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 194/383] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:45.825771 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2c479-37d4-45ca-978f-d40d91e169ea None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:45.891627 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:45.980729 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2c479-37d4-45ca-978f-d40d91e169ea None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:46.018562 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882cd0b2-d8b3-4c4c-bced-42749432364f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:46.019239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cd0b2-d8b3-4c4c-bced-42749432364f None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:46.019521 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cd0b2-d8b3-4c4c-bced-42749432364f None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:46.019796 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882cd0b2-d8b3-4c4c-bced-42749432364f None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:46.020543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cd0b2-d8b3-4c4c-bced-42749432364f None admin] RBAC: Adding query filter params (name=member) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:46.020887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cd0b2-d8b3-4c4c-bced-42749432364f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:46.022269 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882cd0b2-d8b3-4c4c-bced-42749432364f None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:46.032398 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 190/384] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:46.037974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1547fee-717c-4150-bca4-48c789dad05f None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:46.063032 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b309c-1a18-4b38-9aa0-d5891380515c None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:46.063937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b309c-1a18-4b38-9aa0-d5891380515c None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:46.064224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615b309c-1a18-4b38-9aa0-d5891380515c None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:46.066215 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 191/385] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:49:46.073519 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788946d-4833-4b5a-8793-97ebeaa97b5e None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:46.073818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788946d-4833-4b5a-8793-97ebeaa97b5e None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:46.074103 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788946d-4833-4b5a-8793-97ebeaa97b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:46.105121 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-7788946d-4833-4b5a-8793-97ebeaa97b5e None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:46.107360 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-7788946d-4833-4b5a-8793-97ebeaa97b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:46.239595 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 192/386] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:46.257050 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1547fee-717c-4150-bca4-48c789dad05f None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:46.294743 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788946d-4833-4b5a-8793-97ebeaa97b5e None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:46.298536 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe408e2-dac7-4653-8b26-64a8c80e490f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:46.299391 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe408e2-dac7-4653-8b26-64a8c80e490f None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:46.299678 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe408e2-dac7-4653-8b26-64a8c80e490f None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:46.299956 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe408e2-dac7-4653-8b26-64a8c80e490f None admin] PATH_INFO: `/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:46.301163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe408e2-dac7-4653-8b26-64a8c80e490f None admin] RBAC: Authorizing `identity:get_group(group_id=7f3f0a93ed3849b2be01e7df3dfa0828)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:46.302615 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe408e2-dac7-4653-8b26-64a8c80e490f None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:46.304511 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 195/387] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 12:49:46 2022] GET /identity/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828 => generated 226 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:46.310414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe408e2-dac7-4653-8b26-64a8c80e490f None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:46.343906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:46.351333 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:46.414055 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe408e2-dac7-4653-8b26-64a8c80e490f None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:46.449626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5093212-757b-4952-9412-627dbe6cf16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:46.450615 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5093212-757b-4952-9412-627dbe6cf16e None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:46.450998 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5093212-757b-4952-9412-627dbe6cf16e None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:46.451282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5093212-757b-4952-9412-627dbe6cf16e None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:46.452603 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5093212-757b-4952-9412-627dbe6cf16e None admin] RBAC: Authorizing `identity:get_project(project_id=5c24e2362747458280e0394abcfd13a3)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:46.454212 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5093212-757b-4952-9412-627dbe6cf16e None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:46.456235 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 196/388] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:46 2022] GET /identity/v3/projects/5c24e2362747458280e0394abcfd13a3 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:46.465556 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5093212-757b-4952-9412-627dbe6cf16e None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:46.466182 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788946d-4833-4b5a-8793-97ebeaa97b5e None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:46.522340 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcb7be-2a24-4b64-abe1-6e85ed8daa41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:46.523146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcb7be-2a24-4b64-abe1-6e85ed8daa41 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:46.523546 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcb7be-2a24-4b64-abe1-6e85ed8daa41 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:46.523820 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdcb7be-2a24-4b64-abe1-6e85ed8daa41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:46.543466 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdcb7be-2a24-4b64-abe1-6e85ed8daa41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:46.552205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-3cdcb7be-2a24-4b64-abe1-6e85ed8daa41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:46.552205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:46.552205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:46.552205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:46.552205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:46.552205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:46.552205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:46.552205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:46.552205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:46.552205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:46.552205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:46.552205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:46.552205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:46.552205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:46.552205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:46.552205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:46.563146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:46.563146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:46.563146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:46.563146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:46.563146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:46.563146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:46.563146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:46.563146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:46.563146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:46.563146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:46.563146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:46.563146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:46.563146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:46.563146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:46.563146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:46.563146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:46.563928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:46.563928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:46.563928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:46.563928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:46.563928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:46.563928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:46.563928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:46.563928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:46.563928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:46.563928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:46.563928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:46.563928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:46.563928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 193/389] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:49:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:46.563928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcb7be-2a24-4b64-abe1-6e85ed8daa41 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:46.651566 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:46.674632 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5093212-757b-4952-9412-627dbe6cf16e None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:46.679737 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdcb7be-2a24-4b64-abe1-6e85ed8daa41 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:46.683044 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:46.721394 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a59600-91d7-490a-91eb-eef04ea393da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:46.722069 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a59600-91d7-490a-91eb-eef04ea393da None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:46.722346 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a59600-91d7-490a-91eb-eef04ea393da None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:46.722621 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a59600-91d7-490a-91eb-eef04ea393da None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:46.723548 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a59600-91d7-490a-91eb-eef04ea393da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:46.723860 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a59600-91d7-490a-91eb-eef04ea393da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:46.725266 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a59600-91d7-490a-91eb-eef04ea393da None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:46.734616 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 194/390] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:49:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:46.740912 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a59600-91d7-490a-91eb-eef04ea393da None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:46.755557 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471ef0a-1cc1-4e8e-a193-6675c3a2504e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:46.757085 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471ef0a-1cc1-4e8e-a193-6675c3a2504e None admin] REQUEST_METHOD: `PUT` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:46.768469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471ef0a-1cc1-4e8e-a193-6675c3a2504e None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:46.768469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0471ef0a-1cc1-4e8e-a193-6675c3a2504e None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3/groups/7f3f0a93ed3849b2be01e7df3dfa0828/roles/669c23212b4843c8900c3d2e58fb6e0f` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:46.768469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471ef0a-1cc1-4e8e-a193-6675c3a2504e None admin] RBAC: Authorizing `identity:create_grant(project_id=5c24e2362747458280e0394abcfd13a3, group_id=7f3f0a93ed3849b2be01e7df3dfa0828, role_id=669c23212b4843c8900c3d2e58fb6e0f)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:46.768469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0471ef0a-1cc1-4e8e-a193-6675c3a2504e None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:46.849837 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 197/391] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jul 14 12:49:46 2022] PUT /identity/v3/projects/5c24e2362747458280e0394abcfd13a3/groups/7f3f0a93ed3849b2be01e7df3dfa0828/roles/669c23212b4843c8900c3d2e58fb6e0f => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:49:46.871498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a59600-91d7-490a-91eb-eef04ea393da None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:46.910040 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33951e5-3de6-4989-82ee-bad9306e9628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:46.911234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33951e5-3de6-4989-82ee-bad9306e9628 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:46.911689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33951e5-3de6-4989-82ee-bad9306e9628 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:46.912133 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33951e5-3de6-4989-82ee-bad9306e9628 None admin] PATH_INFO: `/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:46.913580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33951e5-3de6-4989-82ee-bad9306e9628 None admin] RBAC: Authorizing `identity:get_group(group_id=7f3f0a93ed3849b2be01e7df3dfa0828)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:46.915209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33951e5-3de6-4989-82ee-bad9306e9628 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:46.917456 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 195/392] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 12:49:46 2022] GET /identity/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:46.925794 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471ef0a-1cc1-4e8e-a193-6675c3a2504e None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:47.063837 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0471ef0a-1cc1-4e8e-a193-6675c3a2504e None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:47.110521 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6080c3-4c82-4f38-b55f-422b9af7fbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:47.111376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6080c3-4c82-4f38-b55f-422b9af7fbd1 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:47.111664 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6080c3-4c82-4f38-b55f-422b9af7fbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:47.111994 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6080c3-4c82-4f38-b55f-422b9af7fbd1 None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:47.117570 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6080c3-4c82-4f38-b55f-422b9af7fbd1 None admin] RBAC: Authorizing `identity:get_project(project_id=5c24e2362747458280e0394abcfd13a3)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:47.119198 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6080c3-4c82-4f38-b55f-422b9af7fbd1 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:47.121507 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 198/393] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:46 2022] GET /identity/v3/projects/5c24e2362747458280e0394abcfd13a3 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:47.132536 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33951e5-3de6-4989-82ee-bad9306e9628 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:47.159896 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:47.264832 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33951e5-3de6-4989-82ee-bad9306e9628 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:47.314001 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3662e-675a-439d-a19b-d31da0df2bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:47.314899 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3662e-675a-439d-a19b-d31da0df2bf4 None admin] REQUEST_METHOD: `PUT` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:47.315185 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3662e-675a-439d-a19b-d31da0df2bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:47.315461 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d3662e-675a-439d-a19b-d31da0df2bf4 None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3/groups/7f3f0a93ed3849b2be01e7df3dfa0828/roles/4c8541aa8143464aa29696e1d957e9b5` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:47.322016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3662e-675a-439d-a19b-d31da0df2bf4 None admin] RBAC: Authorizing `identity:create_grant(project_id=5c24e2362747458280e0394abcfd13a3, group_id=7f3f0a93ed3849b2be01e7df3dfa0828, role_id=4c8541aa8143464aa29696e1d957e9b5)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:47.323479 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d3662e-675a-439d-a19b-d31da0df2bf4 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:47.365129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff87834-7c27-41f1-b5b2-cf9da33c1aa8 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:47.365419 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff87834-7c27-41f1-b5b2-cf9da33c1aa8 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:47.365612 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff87834-7c27-41f1-b5b2-cf9da33c1aa8 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:47.367253 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 199/394] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:47.372236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c90ac-6463-4817-bad9-cafe897cfc48 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:47.372529 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c90ac-6463-4817-bad9-cafe897cfc48 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:47.372864 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c90ac-6463-4817-bad9-cafe897cfc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:47.391700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-785c90ac-6463-4817-bad9-cafe897cfc48 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:47.392952 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-785c90ac-6463-4817-bad9-cafe897cfc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:47.428752 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 196/395] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jul 14 12:49:47 2022] PUT /identity/v3/projects/5c24e2362747458280e0394abcfd13a3/groups/7f3f0a93ed3849b2be01e7df3dfa0828/roles/4c8541aa8143464aa29696e1d957e9b5 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:49:47.435219 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:47.485986 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 200/396] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:47.523038 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3662e-675a-439d-a19b-d31da0df2bf4 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:47.606333 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:47.645024 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d3662e-675a-439d-a19b-d31da0df2bf4 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:47.683090 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949cc033-7668-4bf5-aafe-8d73d82c2f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:47.684172 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cc033-7668-4bf5-aafe-8d73d82c2f6a None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:47.684908 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cc033-7668-4bf5-aafe-8d73d82c2f6a None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:47.685251 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949cc033-7668-4bf5-aafe-8d73d82c2f6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:47.698491 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949cc033-7668-4bf5-aafe-8d73d82c2f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:47.706788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-949cc033-7668-4bf5-aafe-8d73d82c2f6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:47.706788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:47.706788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:47.706788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:47.706788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:47.706788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:47.706788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:47.706788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:47.706788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:47.706788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:47.706788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:47.706788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:47.706788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:47.706788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:47.706788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:47.706788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:47.707818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:47.707818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:47.707818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:47.707818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:47.707818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:47.707818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:47.707818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:47.707818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:47.707818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:47.707818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:47.707818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:47.707818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:47.707818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:47.707818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:47.707818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:47.707818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:47.709658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:47.709658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:47.709658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:47.709658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:47.709658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:47.709658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:47.709658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:47.709658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:47.709658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:47.709658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:47.709658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:47.709658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:47.709658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 197/397] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:47.714626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c90ac-6463-4817-bad9-cafe897cfc48 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:47.739486 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed5b54-151c-4a44-bbd9-e0bb5c968dd0 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:47.739486 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed5b54-151c-4a44-bbd9-e0bb5c968dd0 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:47.739486 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed5b54-151c-4a44-bbd9-e0bb5c968dd0 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:47.740298 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 198/398] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:47.746157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd408642-1a59-47f6-93ea-3e72f9a8e6db None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:47.746769 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd408642-1a59-47f6-93ea-3e72f9a8e6db None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:47.747256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd408642-1a59-47f6-93ea-3e72f9a8e6db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:47.766754 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-dd408642-1a59-47f6-93ea-3e72f9a8e6db None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:47.768340 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-dd408642-1a59-47f6-93ea-3e72f9a8e6db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:47.835314 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c90ac-6463-4817-bad9-cafe897cfc48 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:47.841050 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 199/399] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:47.868663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd408642-1a59-47f6-93ea-3e72f9a8e6db None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:47.879160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817c8db-26b1-457f-bc6a-96f9155c863d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:47.879848 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817c8db-26b1-457f-bc6a-96f9155c863d None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:47.880130 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817c8db-26b1-457f-bc6a-96f9155c863d None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:47.880405 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817c8db-26b1-457f-bc6a-96f9155c863d None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:47.881208 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817c8db-26b1-457f-bc6a-96f9155c863d None admin] RBAC: Adding query filter params (name=member) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:47.881518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817c8db-26b1-457f-bc6a-96f9155c863d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:47.883056 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817c8db-26b1-457f-bc6a-96f9155c863d None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:47.893180 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 201/400] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:47.899157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817c8db-26b1-457f-bc6a-96f9155c863d None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:47.929576 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:47.939262 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:48.017753 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd408642-1a59-47f6-93ea-3e72f9a8e6db None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:48.052459 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817c8db-26b1-457f-bc6a-96f9155c863d None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:48.058383 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bef62-16e4-444f-a721-ad6056570258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:48.059252 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bef62-16e4-444f-a721-ad6056570258 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:48.059544 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bef62-16e4-444f-a721-ad6056570258 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:48.059821 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bef62-16e4-444f-a721-ad6056570258 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:48.070970 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bef62-16e4-444f-a721-ad6056570258 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:48.079165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-c62bef62-16e4-444f-a721-ad6056570258 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:48.079165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:48.079165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:48.079165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:48.079165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:48.079165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:48.079165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:48.079165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:48.079165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:48.079165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:48.079165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:48.079165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:48.079165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:48.079165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:48.079165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:48.079165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:48.080068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:48.080068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:48.080068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:48.080068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:48.080068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:48.080068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:48.080068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:48.080068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:48.080068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:48.080068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:48.080068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:48.080068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:48.080068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:48.080068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:48.080068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:48.080068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:48.081296 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:48.081296 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:48.081296 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:48.081296 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:48.081296 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:48.081296 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:48.081296 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:48.081296 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:48.081296 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:48.081296 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:48.081296 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:48.081296 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:48.081296 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 200/401] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:49:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:48.082150 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a62b2-318a-44f4-aebe-fc22be6ecde0 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:48.082320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a62b2-318a-44f4-aebe-fc22be6ecde0 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:48.083519 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5a62b2-318a-44f4-aebe-fc22be6ecde0 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:48.084110 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 201/402] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:48.089771 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a62b2-318a-44f4-aebe-fc22be6ecde0 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:48.094765 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b32a1-100d-48a4-84ce-9b0b7b15bb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:48.095643 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b32a1-100d-48a4-84ce-9b0b7b15bb63 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:48.095927 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b32a1-100d-48a4-84ce-9b0b7b15bb63 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:48.096206 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b32a1-100d-48a4-84ce-9b0b7b15bb63 None admin] PATH_INFO: `/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:48.097448 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b32a1-100d-48a4-84ce-9b0b7b15bb63 None admin] RBAC: Authorizing `identity:get_group(group_id=7f3f0a93ed3849b2be01e7df3dfa0828)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:48.098924 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b32a1-100d-48a4-84ce-9b0b7b15bb63 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:48.100885 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 202/403] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 12:49:47 2022] GET /identity/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:48.102168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82840ddd-8795-415d-8531-0faf31811788 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:48.102466 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82840ddd-8795-415d-8531-0faf31811788 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:48.102746 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82840ddd-8795-415d-8531-0faf31811788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:48.119427 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-82840ddd-8795-415d-8531-0faf31811788 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:48.120672 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-82840ddd-8795-415d-8531-0faf31811788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:48.208497 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 203/404] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:48.210103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82840ddd-8795-415d-8531-0faf31811788 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:48.210211 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5a62b2-318a-44f4-aebe-fc22be6ecde0 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:48.236013 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:48.247355 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:48.262799 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83226f-e0f3-4fef-8845-19efe0e35c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:48.263792 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83226f-e0f3-4fef-8845-19efe0e35c7f None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:48.264283 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83226f-e0f3-4fef-8845-19efe0e35c7f None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:48.265310 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf83226f-e0f3-4fef-8845-19efe0e35c7f None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:48.266286 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83226f-e0f3-4fef-8845-19efe0e35c7f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:48.267186 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83226f-e0f3-4fef-8845-19efe0e35c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:48.269141 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf83226f-e0f3-4fef-8845-19efe0e35c7f None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:48.282355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 202/405] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:49:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:48.283480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83226f-e0f3-4fef-8845-19efe0e35c7f None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:48.338543 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82840ddd-8795-415d-8531-0faf31811788 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:48.383776 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9f366-f0e7-48aa-9e2f-ab34efdc0fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:48.385565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9f366-f0e7-48aa-9e2f-ab34efdc0fcb None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:48.386508 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9f366-f0e7-48aa-9e2f-ab34efdc0fcb None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:48.387283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc9f366-f0e7-48aa-9e2f-ab34efdc0fcb None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:48.389011 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9f366-f0e7-48aa-9e2f-ab34efdc0fcb None admin] RBAC: Authorizing `identity:get_project(project_id=4939ee9d222341dca515aa1fa4cff0d1)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:48.392063 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc9f366-f0e7-48aa-9e2f-ab34efdc0fcb None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:48.395038 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 204/406] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:48 2022] GET /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:48.396163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9f366-f0e7-48aa-9e2f-ab34efdc0fcb None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:48.410148 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf83226f-e0f3-4fef-8845-19efe0e35c7f None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:48.449946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d238a-2b8e-467e-86d1-9c11296366cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:48.450690 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d238a-2b8e-467e-86d1-9c11296366cb None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:48.450973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d238a-2b8e-467e-86d1-9c11296366cb None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:48.451295 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d238a-2b8e-467e-86d1-9c11296366cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:48.465367 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d238a-2b8e-467e-86d1-9c11296366cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:48.473966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-613d238a-2b8e-467e-86d1-9c11296366cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:49:48.473966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:48.473966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:48.473966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:48.473966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:48.473966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:48.473966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:48.473966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:48.473966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:48.473966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:48.473966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:48.473966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:48.473966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:48.473966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:48.473966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:48.473966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:48.474919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:48.474919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:48.474919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:48.474919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:48.474919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:48.474919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:48.474919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:48.474919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:48.474919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:48.474919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:48.474919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:48.474919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:48.474919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:48.474919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:48.474919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:48.474919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:48.475718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:48.475718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:48.475718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:48.475718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:48.475718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:48.475718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:48.475718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:48.475718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:48.475718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:48.475718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:48.475718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:49:48.475718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:48.475718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 203/407] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 12:49:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:48.476393 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d238a-2b8e-467e-86d1-9c11296366cb None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:48.533995 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:48.543779 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:48.555380 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc9f366-f0e7-48aa-9e2f-ab34efdc0fcb None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:48.597638 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a904d-6f3c-4756-8440-40e475a3e36d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:48.599742 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a904d-6f3c-4756-8440-40e475a3e36d None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:48.600778 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a904d-6f3c-4756-8440-40e475a3e36d None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:48.601298 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a904d-6f3c-4756-8440-40e475a3e36d None admin] PATH_INFO: `/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:48.603240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a904d-6f3c-4756-8440-40e475a3e36d None admin] RBAC: Authorizing `identity:get_group(group_id=7f3f0a93ed3849b2be01e7df3dfa0828)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:48.604477 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d238a-2b8e-467e-86d1-9c11296366cb None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:48.605083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a904d-6f3c-4756-8440-40e475a3e36d None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:48.607869 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 205/408] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 12:49:48 2022] GET /identity/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:48.613152 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a904d-6f3c-4756-8440-40e475a3e36d None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:48.648657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255aed64-e562-4983-ad98-7d2be0a39306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:48.650108 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255aed64-e562-4983-ad98-7d2be0a39306 None admin] REQUEST_METHOD: `PUT` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:48.650577 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255aed64-e562-4983-ad98-7d2be0a39306 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:48.651036 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255aed64-e562-4983-ad98-7d2be0a39306 None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1/groups/7f3f0a93ed3849b2be01e7df3dfa0828/roles/669c23212b4843c8900c3d2e58fb6e0f` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:48.656963 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255aed64-e562-4983-ad98-7d2be0a39306 None admin] RBAC: Authorizing `identity:create_grant(project_id=4939ee9d222341dca515aa1fa4cff0d1, group_id=7f3f0a93ed3849b2be01e7df3dfa0828, role_id=669c23212b4843c8900c3d2e58fb6e0f)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:48.658544 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255aed64-e562-4983-ad98-7d2be0a39306 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:48.738439 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a904d-6f3c-4756-8440-40e475a3e36d None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:48.755201 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 204/409] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jul 14 12:49:48 2022] PUT /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1/groups/7f3f0a93ed3849b2be01e7df3dfa0828/roles/669c23212b4843c8900c3d2e58fb6e0f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:49:48.756496 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255aed64-e562-4983-ad98-7d2be0a39306 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:48.779917 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99254b5d-86ce-427e-b48e-6359d1a16230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:48.781097 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99254b5d-86ce-427e-b48e-6359d1a16230 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:48.781590 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99254b5d-86ce-427e-b48e-6359d1a16230 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:48.782094 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99254b5d-86ce-427e-b48e-6359d1a16230 None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:48.783169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99254b5d-86ce-427e-b48e-6359d1a16230 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:48.783722 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99254b5d-86ce-427e-b48e-6359d1a16230 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:48.785712 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99254b5d-86ce-427e-b48e-6359d1a16230 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:48.805306 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 206/410] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:48.811534 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99254b5d-86ce-427e-b48e-6359d1a16230 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:48.857609 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:48.884627 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255aed64-e562-4983-ad98-7d2be0a39306 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:48.889397 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:48.961861 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e0fb8-e596-43fc-b569-cb2752ac470e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:48.963167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e0fb8-e596-43fc-b569-cb2752ac470e None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:48.963661 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e0fb8-e596-43fc-b569-cb2752ac470e None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:48.964183 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e0fb8-e596-43fc-b569-cb2752ac470e None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:48.965850 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e0fb8-e596-43fc-b569-cb2752ac470e None admin] RBAC: Authorizing `identity:get_project(project_id=4939ee9d222341dca515aa1fa4cff0d1)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:48.967991 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920e0fb8-e596-43fc-b569-cb2752ac470e None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:48.979080 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 205/411] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:48 2022] GET /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:48.985956 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e0fb8-e596-43fc-b569-cb2752ac470e None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:49.012756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99254b5d-86ce-427e-b48e-6359d1a16230 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:49.074317 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bd262-7ed0-4d1b-ad94-9eb4c7616287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:49.076455 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bd262-7ed0-4d1b-ad94-9eb4c7616287 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:49.077144 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bd262-7ed0-4d1b-ad94-9eb4c7616287 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:49.078397 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306bd262-7ed0-4d1b-ad94-9eb4c7616287 None admin] PATH_INFO: `/v3/groups/280441d4a7ed448bb65e2395d74ed939` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:49.081312 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306bd262-7ed0-4d1b-ad94-9eb4c7616287 None admin] RBAC: Authorizing `identity:get_group(group_id=280441d4a7ed448bb65e2395d74ed939)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:49.083593 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306bd262-7ed0-4d1b-ad94-9eb4c7616287 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:49.086623 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 207/412] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 12:49:48 2022] GET /identity/v3/groups/280441d4a7ed448bb65e2395d74ed939 => generated 229 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:49.092620 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bd262-7ed0-4d1b-ad94-9eb4c7616287 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:49.145664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920e0fb8-e596-43fc-b569-cb2752ac470e None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:49.183727 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad95708-cbc4-488c-9d04-24fe62e86fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:49.184611 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad95708-cbc4-488c-9d04-24fe62e86fd0 None admin] REQUEST_METHOD: `PUT` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:49.184923 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad95708-cbc4-488c-9d04-24fe62e86fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:49.185204 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad95708-cbc4-488c-9d04-24fe62e86fd0 None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1/groups/7f3f0a93ed3849b2be01e7df3dfa0828/roles/4c8541aa8143464aa29696e1d957e9b5` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:49.187694 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad95708-cbc4-488c-9d04-24fe62e86fd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=4939ee9d222341dca515aa1fa4cff0d1, group_id=7f3f0a93ed3849b2be01e7df3dfa0828, role_id=4c8541aa8143464aa29696e1d957e9b5)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:49.189324 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad95708-cbc4-488c-9d04-24fe62e86fd0 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:49.209414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:49.214832 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306bd262-7ed0-4d1b-ad94-9eb4c7616287 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:49.251598 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a1a21-0e65-48db-a55a-3d3379fe226c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:49.252834 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a1a21-0e65-48db-a55a-3d3379fe226c None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:49.253434 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a1a21-0e65-48db-a55a-3d3379fe226c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:49.253910 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307a1a21-0e65-48db-a55a-3d3379fe226c None admin] PATH_INFO: `/v3/projects/c24ba159095c44f2835516dff526567e` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:49.255370 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a1a21-0e65-48db-a55a-3d3379fe226c None admin] RBAC: Authorizing `identity:get_project(project_id=c24ba159095c44f2835516dff526567e)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:49.257074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307a1a21-0e65-48db-a55a-3d3379fe226c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:49.259406 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 208/413] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:49 2022] GET /identity/v3/projects/c24ba159095c44f2835516dff526567e => generated 344 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:49.269684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a1a21-0e65-48db-a55a-3d3379fe226c None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:49.278371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 206/414] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jul 14 12:49:48 2022] PUT /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1/groups/7f3f0a93ed3849b2be01e7df3dfa0828/roles/4c8541aa8143464aa29696e1d957e9b5 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:49:49.382797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307a1a21-0e65-48db-a55a-3d3379fe226c None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:49.440281 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c41507-e529-4d32-be51-b43305dfb56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:49.441670 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c41507-e529-4d32-be51-b43305dfb56f None admin] REQUEST_METHOD: `PUT` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:49.442215 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c41507-e529-4d32-be51-b43305dfb56f None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:49.442692 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c41507-e529-4d32-be51-b43305dfb56f None admin] PATH_INFO: `/v3/projects/c24ba159095c44f2835516dff526567e/groups/280441d4a7ed448bb65e2395d74ed939/roles/9bca71f77ac24a898d3445ab3c205809` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:49.448354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c41507-e529-4d32-be51-b43305dfb56f None admin] RBAC: Authorizing `identity:create_grant(project_id=c24ba159095c44f2835516dff526567e, group_id=280441d4a7ed448bb65e2395d74ed939, role_id=9bca71f77ac24a898d3445ab3c205809)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:49.450264 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c41507-e529-4d32-be51-b43305dfb56f None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:49.519313 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 209/415] 10.222.0.40 () {58 vars in 1442 bytes} [Thu Jul 14 12:49:49 2022] PUT /identity/v3/projects/c24ba159095c44f2835516dff526567e/groups/280441d4a7ed448bb65e2395d74ed939/roles/9bca71f77ac24a898d3445ab3c205809 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:49:49.637009 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a9292-47d6-4440-b40e-b4c340a10280 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:49.637507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a9292-47d6-4440-b40e-b4c340a10280 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:49.637581 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a9292-47d6-4440-b40e-b4c340a10280 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:49.639585 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 207/416] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:49.653007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f9e8-2321-49ed-b829-dc62e54366b0 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:49.653350 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f9e8-2321-49ed-b829-dc62e54366b0 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:49.653706 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e866f9e8-2321-49ed-b829-dc62e54366b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:49.678275 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-e866f9e8-2321-49ed-b829-dc62e54366b0 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:49.679527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-e866f9e8-2321-49ed-b829-dc62e54366b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:49.699158 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:49.770866 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 210/417] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:49.796810 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a9292-47d6-4440-b40e-b4c340a10280 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:49.834451 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:49.911080 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a9292-47d6-4440-b40e-b4c340a10280 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:49.945750 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1faf6-6633-4138-a9d3-c78d122cfdbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:49.946549 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1faf6-6633-4138-a9d3-c78d122cfdbf None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:49.946834 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1faf6-6633-4138-a9d3-c78d122cfdbf None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:49.947109 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1faf6-6633-4138-a9d3-c78d122cfdbf None admin] PATH_INFO: `/v3/roles/member` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:49.958545 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d1faf6-6633-4138-a9d3-c78d122cfdbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:49.966777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-06d1faf6-6633-4138-a9d3-c78d122cfdbf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:49.966777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:49.966777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:49.966777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:49.966777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:49.966777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:49.966777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:49.966777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:49.966777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:49.966777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:49.966777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:49.966777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:49.966777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:49.966777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:49.966777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:49.966777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:49.967682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:49.967682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:49.967682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:49.967682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:49.967682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:49.967682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:49.967682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:49.967682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:49.967682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:49.967682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:49.967682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:49.967682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:49.967682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:49.967682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:49.967682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:49.967682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:49.969091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:49.969091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:49.969091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:49.969091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:49.969091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:49.969091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:49.969091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:49.969091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:49.969091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:49.969091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:49.969091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:49.969091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:49.969091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 208/418] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:49.980232 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866f9e8-2321-49ed-b829-dc62e54366b0 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:50.097572 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e866f9e8-2321-49ed-b829-dc62e54366b0 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:50.158777 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ca1a48-77d5-4d54-803a-facd7f6c3395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:50.159843 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca1a48-77d5-4d54-803a-facd7f6c3395 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:50.160312 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca1a48-77d5-4d54-803a-facd7f6c3395 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:50.160796 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ca1a48-77d5-4d54-803a-facd7f6c3395 None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:50.161802 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca1a48-77d5-4d54-803a-facd7f6c3395 None admin] RBAC: Adding query filter params (name=member) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:50.162289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca1a48-77d5-4d54-803a-facd7f6c3395 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:50.163856 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ca1a48-77d5-4d54-803a-facd7f6c3395 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:50.178582 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 211/419] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:50.184287 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1faf6-6633-4138-a9d3-c78d122cfdbf None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:50.228649 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843169ae-8dd8-455e-93be-a5bbea4a0574 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:50.228649 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843169ae-8dd8-455e-93be-a5bbea4a0574 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:50.228649 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843169ae-8dd8-455e-93be-a5bbea4a0574 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:50.228649 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 212/420] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:50.246257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac208e-df2d-4495-b63b-4ccdb12a162b None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:50.246558 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac208e-df2d-4495-b63b-4ccdb12a162b None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:50.246811 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cac208e-df2d-4495-b63b-4ccdb12a162b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:50.264127 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-8cac208e-df2d-4495-b63b-4ccdb12a162b None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:50.265372 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-8cac208e-df2d-4495-b63b-4ccdb12a162b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:50.269069 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:50.348663 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 213/421] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:50.349508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:50.373788 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac208e-df2d-4495-b63b-4ccdb12a162b None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:50.378940 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1faf6-6633-4138-a9d3-c78d122cfdbf None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:50.414976 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec2bc6-39d0-4a69-a915-6ea662d67be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:50.415550 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec2bc6-39d0-4a69-a915-6ea662d67be3 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:50.415837 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec2bc6-39d0-4a69-a915-6ea662d67be3 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:50.416114 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ec2bc6-39d0-4a69-a915-6ea662d67be3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:50.490608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec2bc6-39d0-4a69-a915-6ea662d67be3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:50.492215 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ec2bc6-39d0-4a69-a915-6ea662d67be3 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:50.602329 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 209/422] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:50.605087 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:50.610754 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec2bc6-39d0-4a69-a915-6ea662d67be3 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:50.650032 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cac208e-df2d-4495-b63b-4ccdb12a162b None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:50.694344 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa363547-48fe-41f3-841c-a75a3bbe5fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:50.695090 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa363547-48fe-41f3-841c-a75a3bbe5fc8 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:50.695374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa363547-48fe-41f3-841c-a75a3bbe5fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:50.695650 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa363547-48fe-41f3-841c-a75a3bbe5fc8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:50.713042 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:50.721038 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa363547-48fe-41f3-841c-a75a3bbe5fc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:50.735540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-fa363547-48fe-41f3-841c-a75a3bbe5fc8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:50.735540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:50.735540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:50.735540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:50.735540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:50.735540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:50.735540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:50.735540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:50.735540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:50.735540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:50.735540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:50.735540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:50.735540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:50.735540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:50.735540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:50.735540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:50.736494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:50.736494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:50.736494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:50.736494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:50.736494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:50.736494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:50.736494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:50.736494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:50.736494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:50.736494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:50.736494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:50.736494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:50.736494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:50.736494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:50.736494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:50.736494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:50.737327 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:50.737327 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:50.737327 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:50.737327 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:50.737327 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:50.737327 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:50.737327 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:50.737327 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:50.737327 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:50.737327 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:50.737327 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:50.737327 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:50.740877 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 214/423] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:49:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:49:50.745090 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa363547-48fe-41f3-841c-a75a3bbe5fc8 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:50.819914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ec2bc6-39d0-4a69-a915-6ea662d67be3 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:50.874681 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efb056-87c9-44f4-ba9a-fb1e1b9a0a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:50.875560 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efb056-87c9-44f4-ba9a-fb1e1b9a0a1e None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:50.875843 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efb056-87c9-44f4-ba9a-fb1e1b9a0a1e None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:50.876116 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28efb056-87c9-44f4-ba9a-fb1e1b9a0a1e None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:50.878040 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efb056-87c9-44f4-ba9a-fb1e1b9a0a1e None admin] RBAC: Authorizing `identity:get_project(project_id=5c24e2362747458280e0394abcfd13a3)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:50.879503 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28efb056-87c9-44f4-ba9a-fb1e1b9a0a1e None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:50.881398 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 210/424] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:50 2022] GET /identity/v3/projects/5c24e2362747458280e0394abcfd13a3 => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:50.887289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efb056-87c9-44f4-ba9a-fb1e1b9a0a1e None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:50.989169 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:51.025844 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28efb056-87c9-44f4-ba9a-fb1e1b9a0a1e None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:51.049658 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa363547-48fe-41f3-841c-a75a3bbe5fc8 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:51.078925 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463c4c8-b36a-49fc-a050-828f1700be4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:51.079788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463c4c8-b36a-49fc-a050-828f1700be4e None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:51.080073 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463c4c8-b36a-49fc-a050-828f1700be4e None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:51.080348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5463c4c8-b36a-49fc-a050-828f1700be4e None admin] PATH_INFO: `/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:51.083093 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463c4c8-b36a-49fc-a050-828f1700be4e None admin] RBAC: Authorizing `identity:get_group(group_id=7f3f0a93ed3849b2be01e7df3dfa0828)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:51.085144 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5463c4c8-b36a-49fc-a050-828f1700be4e None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:51.092006 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 211/425] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 12:49:50 2022] GET /identity/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:51.094779 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463c4c8-b36a-49fc-a050-828f1700be4e None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:51.120132 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a43c6-d468-42be-a3c1-68d2c14b8631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:51.120858 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a43c6-d468-42be-a3c1-68d2c14b8631 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:51.121149 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a43c6-d468-42be-a3c1-68d2c14b8631 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:51.121434 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710a43c6-d468-42be-a3c1-68d2c14b8631 None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:51.122205 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a43c6-d468-42be-a3c1-68d2c14b8631 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:51.122518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a43c6-d468-42be-a3c1-68d2c14b8631 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:51.123940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710a43c6-d468-42be-a3c1-68d2c14b8631 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:51.147632 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 215/426] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:49:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:51.152954 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a43c6-d468-42be-a3c1-68d2c14b8631 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:51.289588 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:51.344380 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5463c4c8-b36a-49fc-a050-828f1700be4e None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:51.375132 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710a43c6-d468-42be-a3c1-68d2c14b8631 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:51.406307 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:51.424316 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f4bf-65ec-42d9-b305-c888e70c3212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:51.425003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f4bf-65ec-42d9-b305-c888e70c3212 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:51.425288 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f4bf-65ec-42d9-b305-c888e70c3212 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:51.425565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561f4bf-65ec-42d9-b305-c888e70c3212 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:51.429424 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f236c0ed-bc11-4bbd-9cc5-965ee4a40d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:51.430103 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236c0ed-bc11-4bbd-9cc5-965ee4a40d39 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:51.430388 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236c0ed-bc11-4bbd-9cc5-965ee4a40d39 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:51.430665 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f236c0ed-bc11-4bbd-9cc5-965ee4a40d39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:51.431639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236c0ed-bc11-4bbd-9cc5-965ee4a40d39 None admin] RBAC: Adding query filter params (group.id=7f3f0a93ed3849b2be01e7df3dfa0828, role.id=669c23212b4843c8900c3d2e58fb6e0f, scope.project.id=5c24e2362747458280e0394abcfd13a3) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:51.431950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236c0ed-bc11-4bbd-9cc5-965ee4a40d39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:51.433439 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f236c0ed-bc11-4bbd-9cc5-965ee4a40d39 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:51.446516 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 212/427] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 12:49:51 2022] GET /identity/v3/role_assignments?group.id=7f3f0a93ed3849b2be01e7df3dfa0828&scope.project.id=5c24e2362747458280e0394abcfd13a3&role.id=669c23212b4843c8900c3d2e58fb6e0f => generated 611 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:51.558099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561f4bf-65ec-42d9-b305-c888e70c3212 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:51.559926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561f4bf-65ec-42d9-b305-c888e70c3212 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:51.560733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e78011-55f1-4947-8482-aada181bf694 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:51.561032 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e78011-55f1-4947-8482-aada181bf694 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:51.561340 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e78011-55f1-4947-8482-aada181bf694 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:51.564376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 213/428] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:51.569116 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e37d5-5013-45c2-9888-569faacea15e None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:51.569405 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e37d5-5013-45c2-9888-569faacea15e None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:51.569684 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52e37d5-5013-45c2-9888-569faacea15e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:51.588067 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-d52e37d5-5013-45c2-9888-569faacea15e None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:51.589250 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-d52e37d5-5013-45c2-9888-569faacea15e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:51.646559 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:51.720353 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 216/429] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:51.721569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f4bf-65ec-42d9-b305-c888e70c3212 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:51.739424 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 214/430] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:51.764899 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e37d5-5013-45c2-9888-569faacea15e None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:51.861797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561f4bf-65ec-42d9-b305-c888e70c3212 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:51.895430 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52e37d5-5013-45c2-9888-569faacea15e None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:51.899918 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942fb10-4467-4247-86af-0032aba6ea45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:51.900846 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942fb10-4467-4247-86af-0032aba6ea45 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:51.901186 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942fb10-4467-4247-86af-0032aba6ea45 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:51.901470 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e942fb10-4467-4247-86af-0032aba6ea45 None admin] PATH_INFO: `/v3/projects/5c24e2362747458280e0394abcfd13a3` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:51.902690 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942fb10-4467-4247-86af-0032aba6ea45 None admin] RBAC: Authorizing `identity:get_project(project_id=5c24e2362747458280e0394abcfd13a3)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:51.904151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e942fb10-4467-4247-86af-0032aba6ea45 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:51.906504 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 217/431] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:51 2022] GET /identity/v3/projects/5c24e2362747458280e0394abcfd13a3 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:51.921618 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942fb10-4467-4247-86af-0032aba6ea45 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:51.935268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:51.950552 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e40a7-1f5e-4bc3-b863-ae308b0eb922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:51.951890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e40a7-1f5e-4bc3-b863-ae308b0eb922 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:51.952188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e40a7-1f5e-4bc3-b863-ae308b0eb922 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:51.952524 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657e40a7-1f5e-4bc3-b863-ae308b0eb922 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:51.965087 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:51.966852 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657e40a7-1f5e-4bc3-b863-ae308b0eb922 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:51.978716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-657e40a7-1f5e-4bc3-b863-ae308b0eb922 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:51.978716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:51.978716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:51.978716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:51.978716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:51.978716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:51.978716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:51.978716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:51.978716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:51.978716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:51.978716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:51.978716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:51.978716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:51.978716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:51.978716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:51.978716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:51.979657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:51.979657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:51.979657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:51.979657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:51.979657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:51.979657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:51.979657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:51.979657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:51.979657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:51.979657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:51.979657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:51.979657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:51.979657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:51.979657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:51.979657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:51.979657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:51.980470 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:51.980470 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:51.980470 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:51.980470 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:51.980470 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:51.980470 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:51.980470 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:51.980470 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:51.980470 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:51.980470 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:51.980470 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 14 12:49:51.980470 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:51.980470 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 215/432] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:51.987954 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e40a7-1f5e-4bc3-b863-ae308b0eb922 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:52.062440 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e942fb10-4467-4247-86af-0032aba6ea45 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:52.110699 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79934b-785e-40fd-a355-7f636879a2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:52.111618 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79934b-785e-40fd-a355-7f636879a2c9 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:52.111960 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79934b-785e-40fd-a355-7f636879a2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:52.112172 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79934b-785e-40fd-a355-7f636879a2c9 None admin] PATH_INFO: `/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:52.114441 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79934b-785e-40fd-a355-7f636879a2c9 None admin] RBAC: Authorizing `identity:get_group(group_id=7f3f0a93ed3849b2be01e7df3dfa0828)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:52.115952 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79934b-785e-40fd-a355-7f636879a2c9 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:52.120748 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 218/433] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 12:49:51 2022] GET /identity/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:52.123137 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657e40a7-1f5e-4bc3-b863-ae308b0eb922 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:52.125893 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79934b-785e-40fd-a355-7f636879a2c9 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:52.173847 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9821a-80b4-45d0-8223-6dbceaff4b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:52.174557 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9821a-80b4-45d0-8223-6dbceaff4b8d None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:52.174995 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9821a-80b4-45d0-8223-6dbceaff4b8d None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:52.175216 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed9821a-80b4-45d0-8223-6dbceaff4b8d None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:52.175989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9821a-80b4-45d0-8223-6dbceaff4b8d None admin] RBAC: Adding query filter params (name=member) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:52.176293 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9821a-80b4-45d0-8223-6dbceaff4b8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:52.177884 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed9821a-80b4-45d0-8223-6dbceaff4b8d None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:52.191881 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 216/434] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:49:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:52.193880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9821a-80b4-45d0-8223-6dbceaff4b8d None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:52.260817 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:52.262995 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:52.265984 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79934b-785e-40fd-a355-7f636879a2c9 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:52.319461 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c459772-3e90-4e8b-b906-316e93398616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:52.320575 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c459772-3e90-4e8b-b906-316e93398616 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:52.321115 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c459772-3e90-4e8b-b906-316e93398616 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:52.321602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c459772-3e90-4e8b-b906-316e93398616 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:52.323085 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c459772-3e90-4e8b-b906-316e93398616 None admin] RBAC: Adding query filter params (group.id=7f3f0a93ed3849b2be01e7df3dfa0828, role.id=4c8541aa8143464aa29696e1d957e9b5, scope.project.id=5c24e2362747458280e0394abcfd13a3) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:52.323644 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c459772-3e90-4e8b-b906-316e93398616 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:52.326588 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c459772-3e90-4e8b-b906-316e93398616 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:52.335752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 219/435] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 12:49:52 2022] GET /identity/v3/role_assignments?group.id=7f3f0a93ed3849b2be01e7df3dfa0828&scope.project.id=5c24e2362747458280e0394abcfd13a3&role.id=4c8541aa8143464aa29696e1d957e9b5 => generated 611 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:52.341544 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c78d2-730b-4581-a961-34f0776fa128 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:52.341838 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c78d2-730b-4581-a961-34f0776fa128 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:52.342118 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726c78d2-730b-4581-a961-34f0776fa128 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:52.344265 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 220/436] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:52.350418 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0fd51-f382-4925-9702-9989f4a1a225 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:52.350682 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0fd51-f382-4925-9702-9989f4a1a225 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:52.351017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c0fd51-f382-4925-9702-9989f4a1a225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:52.353265 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed9821a-80b4-45d0-8223-6dbceaff4b8d None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:52.374009 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-38c0fd51-f382-4925-9702-9989f4a1a225 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:52.376139 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-38c0fd51-f382-4925-9702-9989f4a1a225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:52.400875 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa4466-6003-459b-9931-df0ca0117a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:52.402822 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa4466-6003-459b-9931-df0ca0117a64 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:52.403127 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa4466-6003-459b-9931-df0ca0117a64 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:52.403403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa4466-6003-459b-9931-df0ca0117a64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:52.470423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 221/437] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:52.471832 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df999e18-15cf-49dc-9d09-543604256e60 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:52.472122 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df999e18-15cf-49dc-9d09-543604256e60 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:52.472397 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df999e18-15cf-49dc-9d09-543604256e60 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:52.473949 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 222/438] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:52.479447 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb132d-5cc9-4968-8c9b-b9f5873d7a17 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:52.479744 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb132d-5cc9-4968-8c9b-b9f5873d7a17 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:52.480013 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb132d-5cc9-4968-8c9b-b9f5873d7a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:52.498320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-14bb132d-5cc9-4968-8c9b-b9f5873d7a17 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:52.498516 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa4466-6003-459b-9931-df0ca0117a64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:52.500135 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-14bb132d-5cc9-4968-8c9b-b9f5873d7a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:52.500498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa4466-6003-459b-9931-df0ca0117a64 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:52.553468 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:52.584457 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 223/439] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:52.584457 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb132d-5cc9-4968-8c9b-b9f5873d7a17 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:52.612612 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:52.620828 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 217/440] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 14 12:49:52.621913 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa4466-6003-459b-9931-df0ca0117a64 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:52.718716 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb132d-5cc9-4968-8c9b-b9f5873d7a17 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:52.749869 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa4466-6003-459b-9931-df0ca0117a64 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:52.768064 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a7e77-7a1b-4775-97b0-381f91cbfa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:52.768918 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a7e77-7a1b-4775-97b0-381f91cbfa68 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:52.769202 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a7e77-7a1b-4775-97b0-381f91cbfa68 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:52.769480 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a7e77-7a1b-4775-97b0-381f91cbfa68 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:52.780811 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a7e77-7a1b-4775-97b0-381f91cbfa68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:52.788928 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-790a7e77-7a1b-4775-97b0-381f91cbfa68 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:52.788928 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:52.788928 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:52.788928 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:52.788928 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:52.788928 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:52.788928 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:52.788928 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:52.788928 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:52.788928 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:52.788928 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:52.788928 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:52.788928 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:52.788928 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:52.788928 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:52.788928 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:52.789835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:52.789835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:52.789835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:52.789835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:52.789835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:52.789835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:52.789835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:52.789835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:52.789835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:52.789835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:52.789835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:52.789835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:52.789835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:52.789835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:52.789835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:52.789835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:52.791146 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:52.791146 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:52.791146 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:52.791146 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:52.791146 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:52.791146 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:52.791146 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:52.791146 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:52.791146 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:52.791146 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:52.791146 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 14 12:49:52.791146 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:52.791146 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 224/441] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:49:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:52.791146 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a7e77-7a1b-4775-97b0-381f91cbfa68 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:52.793914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b676835-60a8-4c68-a7e2-ad69bd347127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:52.794711 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b676835-60a8-4c68-a7e2-ad69bd347127 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:52.795215 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b676835-60a8-4c68-a7e2-ad69bd347127 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:52.795337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b676835-60a8-4c68-a7e2-ad69bd347127 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:52.806111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b676835-60a8-4c68-a7e2-ad69bd347127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:49:52.814202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-9b676835-60a8-4c68-a7e2-ad69bd347127 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:49:52.814202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:52.814202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:52.814202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:52.814202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:52.814202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:52.814202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:52.814202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:52.814202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:52.814202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:52.814202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:52.814202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:52.814202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:49:52.814202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:49:52.814202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:49:52.814202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:49:52.815420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:49:52.815420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:49:52.815420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:49:52.815420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:49:52.815420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:52.815420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:52.815420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:52.815420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:52.815420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:52.815420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:52.815420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:52.815420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:52.815420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:52.815420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:52.815420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:52.815420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:52.816429 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:52.816429 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:52.816429 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:52.816429 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:52.816429 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:49:52.816429 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:49:52.816429 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:49:52.816429 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:49:52.816429 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:49:52.816429 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:49:52.816429 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:49:52.816429 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:52.816429 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 218/442] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 12:49:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:52.816429 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b676835-60a8-4c68-a7e2-ad69bd347127 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:52.820186 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:52.878205 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:52.896929 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a7e77-7a1b-4775-97b0-381f91cbfa68 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:52.916155 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b676835-60a8-4c68-a7e2-ad69bd347127 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:52.931596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c687751-fd08-4968-a6b8-29180175dbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:52.932454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c687751-fd08-4968-a6b8-29180175dbc2 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:52.932770 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c687751-fd08-4968-a6b8-29180175dbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:52.933058 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c687751-fd08-4968-a6b8-29180175dbc2 None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:52.934362 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c687751-fd08-4968-a6b8-29180175dbc2 None admin] RBAC: Authorizing `identity:get_project(project_id=4939ee9d222341dca515aa1fa4cff0d1)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:52.935789 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c687751-fd08-4968-a6b8-29180175dbc2 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:52.938078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 225/443] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:52 2022] GET /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1 => generated 302 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:52.938844 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c687751-fd08-4968-a6b8-29180175dbc2 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:52.952076 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce8341-e335-4e39-b6a2-663820b541db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:52.952805 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce8341-e335-4e39-b6a2-663820b541db None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:52.953095 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce8341-e335-4e39-b6a2-663820b541db None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:52.954943 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ce8341-e335-4e39-b6a2-663820b541db None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:52.954943 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce8341-e335-4e39-b6a2-663820b541db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:52.954943 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce8341-e335-4e39-b6a2-663820b541db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:52.955788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ce8341-e335-4e39-b6a2-663820b541db None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:52.964079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 219/444] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:49:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:52.964903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce8341-e335-4e39-b6a2-663820b541db None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:53.032119 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:53.041261 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c687751-fd08-4968-a6b8-29180175dbc2 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:53.066713 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ce8341-e335-4e39-b6a2-663820b541db None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:53.074876 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fb48d-7cdb-4f92-a005-abb1bace2842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:53.075547 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fb48d-7cdb-4f92-a005-abb1bace2842 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:53.075838 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fb48d-7cdb-4f92-a005-abb1bace2842 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:53.076117 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fb48d-7cdb-4f92-a005-abb1bace2842 None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:53.076898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fb48d-7cdb-4f92-a005-abb1bace2842 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:53.077209 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fb48d-7cdb-4f92-a005-abb1bace2842 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:53.080232 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fb48d-7cdb-4f92-a005-abb1bace2842 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:53.087914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 226/445] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:49:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:53.088536 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fb48d-7cdb-4f92-a005-abb1bace2842 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:53.103402 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:53.106615 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29144684-1ce8-4928-ac97-3d64b0086f64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:53.107473 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29144684-1ce8-4928-ac97-3d64b0086f64 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:53.107776 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29144684-1ce8-4928-ac97-3d64b0086f64 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:53.108041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29144684-1ce8-4928-ac97-3d64b0086f64 None admin] PATH_INFO: `/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:53.109286 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29144684-1ce8-4928-ac97-3d64b0086f64 None admin] RBAC: Authorizing `identity:get_group(group_id=7f3f0a93ed3849b2be01e7df3dfa0828)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:53.110723 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29144684-1ce8-4928-ac97-3d64b0086f64 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:53.112420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 220/446] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 12:49:52 2022] GET /identity/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:53.120868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29144684-1ce8-4928-ac97-3d64b0086f64 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:53.189004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fb48d-7cdb-4f92-a005-abb1bace2842 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:53.220619 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29144684-1ce8-4928-ac97-3d64b0086f64 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:53.222624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ece2d-4284-426d-88da-7bd1c568dd48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:53.223271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ece2d-4284-426d-88da-7bd1c568dd48 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:53.223552 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ece2d-4284-426d-88da-7bd1c568dd48 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:53.223823 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ece2d-4284-426d-88da-7bd1c568dd48 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:53.255095 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e908d-cf07-4079-aac9-66786b605b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:53.255799 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e908d-cf07-4079-aac9-66786b605b41 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:53.256090 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e908d-cf07-4079-aac9-66786b605b41 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:53.256364 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e908d-cf07-4079-aac9-66786b605b41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:53.259029 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:53.291112 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ece2d-4284-426d-88da-7bd1c568dd48 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:53.292508 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ece2d-4284-426d-88da-7bd1c568dd48 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:53.306075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:53.325091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e908d-cf07-4079-aac9-66786b605b41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:53.326573 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e908d-cf07-4079-aac9-66786b605b41 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:53.393819 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 227/447] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:53.394896 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ece2d-4284-426d-88da-7bd1c568dd48 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:53.438753 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 221/448] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:49:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:49:53.439431 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e908d-cf07-4079-aac9-66786b605b41 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:53.473031 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:53.497764 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ece2d-4284-426d-88da-7bd1c568dd48 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:53.511468 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:53.532852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e81a83-727a-4246-a868-e03b6188d846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:53.533515 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e81a83-727a-4246-a868-e03b6188d846 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:53.533814 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e81a83-727a-4246-a868-e03b6188d846 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:53.534089 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e81a83-727a-4246-a868-e03b6188d846 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:53.534914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e81a83-727a-4246-a868-e03b6188d846 None admin] RBAC: Adding query filter params (group.id=7f3f0a93ed3849b2be01e7df3dfa0828, role.id=669c23212b4843c8900c3d2e58fb6e0f, scope.project.id=4939ee9d222341dca515aa1fa4cff0d1) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:53.535233 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e81a83-727a-4246-a868-e03b6188d846 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:53.536711 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e81a83-727a-4246-a868-e03b6188d846 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:53.537915 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e908d-cf07-4079-aac9-66786b605b41 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:53.542689 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 228/449] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 12:49:53 2022] GET /identity/v3/role_assignments?group.id=7f3f0a93ed3849b2be01e7df3dfa0828&scope.project.id=4939ee9d222341dca515aa1fa4cff0d1&role.id=669c23212b4843c8900c3d2e58fb6e0f => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:53.543421 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e81a83-727a-4246-a868-e03b6188d846 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:53.577977 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b38b2-33f5-4165-b58c-63406d5cb6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:53.578867 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b38b2-33f5-4165-b58c-63406d5cb6be None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:53.579147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b38b2-33f5-4165-b58c-63406d5cb6be None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:53.579420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465b38b2-33f5-4165-b58c-63406d5cb6be None admin] PATH_INFO: `/v3/projects/4939ee9d222341dca515aa1fa4cff0d1` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:53.580732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b38b2-33f5-4165-b58c-63406d5cb6be None admin] RBAC: Authorizing `identity:get_project(project_id=4939ee9d222341dca515aa1fa4cff0d1)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:53.582254 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465b38b2-33f5-4165-b58c-63406d5cb6be None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:53.584476 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 222/450] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:53 2022] GET /identity/v3/projects/4939ee9d222341dca515aa1fa4cff0d1 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:53.589965 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b38b2-33f5-4165-b58c-63406d5cb6be None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:53.662696 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e81a83-727a-4246-a868-e03b6188d846 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:53.700157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465b38b2-33f5-4165-b58c-63406d5cb6be None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:53.702087 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:53.702393 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1240455-6f94-4162-8961-87cdceea8cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:53.703383 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1240455-6f94-4162-8961-87cdceea8cf0 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:53.703567 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1240455-6f94-4162-8961-87cdceea8cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:53.703845 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1240455-6f94-4162-8961-87cdceea8cf0 None admin] PATH_INFO: `/v3/projects/c24ba159095c44f2835516dff526567e` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:53.705147 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1240455-6f94-4162-8961-87cdceea8cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=c24ba159095c44f2835516dff526567e)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:53.706643 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1240455-6f94-4162-8961-87cdceea8cf0 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:53.708423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 229/451] 10.222.0.40 () {56 vars in 1186 bytes} [Thu Jul 14 12:49:53 2022] GET /identity/v3/projects/c24ba159095c44f2835516dff526567e => generated 344 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:53.714302 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1240455-6f94-4162-8961-87cdceea8cf0 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:53.741919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b5a38-2361-4571-a4c3-38e735f0e9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:53.744334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b5a38-2361-4571-a4c3-38e735f0e9c6 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:53.744334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b5a38-2361-4571-a4c3-38e735f0e9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:53.744334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b5a38-2361-4571-a4c3-38e735f0e9c6 None admin] PATH_INFO: `/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:53.747069 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b5a38-2361-4571-a4c3-38e735f0e9c6 None admin] RBAC: Authorizing `identity:get_group(group_id=7f3f0a93ed3849b2be01e7df3dfa0828)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:53.748665 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b5a38-2361-4571-a4c3-38e735f0e9c6 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:53.751160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 223/452] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 12:49:53 2022] GET /identity/v3/groups/7f3f0a93ed3849b2be01e7df3dfa0828 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:53.757843 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b5a38-2361-4571-a4c3-38e735f0e9c6 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:53.771209 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:53.834146 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1240455-6f94-4162-8961-87cdceea8cf0 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:53.878817 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd7b61-a717-49b1-b2aa-b9dbb3a28984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:53.880011 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd7b61-a717-49b1-b2aa-b9dbb3a28984 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:53.880434 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd7b61-a717-49b1-b2aa-b9dbb3a28984 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:53.880754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cd7b61-a717-49b1-b2aa-b9dbb3a28984 None admin] PATH_INFO: `/v3/groups/280441d4a7ed448bb65e2395d74ed939` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:53.882243 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd7b61-a717-49b1-b2aa-b9dbb3a28984 None admin] RBAC: Authorizing `identity:get_group(group_id=280441d4a7ed448bb65e2395d74ed939)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:53.884153 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cd7b61-a717-49b1-b2aa-b9dbb3a28984 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:53.885660 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b5a38-2361-4571-a4c3-38e735f0e9c6 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:53.886123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 230/453] 10.222.0.40 () {56 vars in 1180 bytes} [Thu Jul 14 12:49:53 2022] GET /identity/v3/groups/280441d4a7ed448bb65e2395d74ed939 => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:53.891624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd7b61-a717-49b1-b2aa-b9dbb3a28984 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:53.930962 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dddc6-1562-4dd7-a7ab-eda91c5df526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:53.931645 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dddc6-1562-4dd7-a7ab-eda91c5df526 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:53.931912 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dddc6-1562-4dd7-a7ab-eda91c5df526 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:53.932195 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dddc6-1562-4dd7-a7ab-eda91c5df526 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:53.933156 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dddc6-1562-4dd7-a7ab-eda91c5df526 None admin] RBAC: Adding query filter params (group.id=7f3f0a93ed3849b2be01e7df3dfa0828, role.id=4c8541aa8143464aa29696e1d957e9b5, scope.project.id=4939ee9d222341dca515aa1fa4cff0d1) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:53.933473 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dddc6-1562-4dd7-a7ab-eda91c5df526 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:53.934918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dddc6-1562-4dd7-a7ab-eda91c5df526 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:53.942572 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 224/454] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 12:49:53 2022] GET /identity/v3/role_assignments?group.id=7f3f0a93ed3849b2be01e7df3dfa0828&scope.project.id=4939ee9d222341dca515aa1fa4cff0d1&role.id=4c8541aa8143464aa29696e1d957e9b5 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:54.005577 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cd7b61-a717-49b1-b2aa-b9dbb3a28984 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:54.019547 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:54.042295 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0231596-a9d4-4f10-b15b-988827fbfa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:54.042998 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0231596-a9d4-4f10-b15b-988827fbfa9c None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:54.043283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0231596-a9d4-4f10-b15b-988827fbfa9c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:54.043563 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0231596-a9d4-4f10-b15b-988827fbfa9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:54.044408 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0231596-a9d4-4f10-b15b-988827fbfa9c None admin] RBAC: Adding query filter params (group.id=280441d4a7ed448bb65e2395d74ed939, role.id=9bca71f77ac24a898d3445ab3c205809, scope.project.id=c24ba159095c44f2835516dff526567e) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:54.044753 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0231596-a9d4-4f10-b15b-988827fbfa9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:54.046289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0231596-a9d4-4f10-b15b-988827fbfa9c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:54.053245 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 231/455] 10.222.0.40 () {56 vars in 1376 bytes} [Thu Jul 14 12:49:53 2022] GET /identity/v3/role_assignments?group.id=280441d4a7ed448bb65e2395d74ed939&scope.project.id=c24ba159095c44f2835516dff526567e&role.id=9bca71f77ac24a898d3445ab3c205809 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:56.674842 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcff9a-93b5-4529-8ce4-19192ebd4990 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:56.675397 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcff9a-93b5-4529-8ce4-19192ebd4990 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:56.675397 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dcff9a-93b5-4529-8ce4-19192ebd4990 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:56.676832 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 225/456] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:56.682393 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3036c-f537-44ce-8e60-719e2b8243f6 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:56.683285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3036c-f537-44ce-8e60-719e2b8243f6 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:56.683790 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c3036c-f537-44ce-8e60-719e2b8243f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:56.703339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-d3c3036c-f537-44ce-8e60-719e2b8243f6 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:56.705028 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-d3c3036c-f537-44ce-8e60-719e2b8243f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:56.787535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 232/457] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:56.813261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcff9a-93b5-4529-8ce4-19192ebd4990 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:56.856162 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:56.871879 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03217ade-c532-4ad2-99bd-c4e0bbb84d29 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:56.872244 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03217ade-c532-4ad2-99bd-c4e0bbb84d29 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:56.872805 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03217ade-c532-4ad2-99bd-c4e0bbb84d29 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:56.874687 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 233/458] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:49:56.880243 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc30e94-1ce9-4631-8b4d-f7a24b75ffee None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:56.887031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc30e94-1ce9-4631-8b4d-f7a24b75ffee None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:56.887031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc30e94-1ce9-4631-8b4d-f7a24b75ffee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:56.899568 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-8cc30e94-1ce9-4631-8b4d-f7a24b75ffee None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:56.901095 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-8cc30e94-1ce9-4631-8b4d-f7a24b75ffee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:56.934130 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dcff9a-93b5-4529-8ce4-19192ebd4990 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:56.974742 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4b9351-d25e-406e-9857-93a4b12395b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:56.975795 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b9351-d25e-406e-9857-93a4b12395b0 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:56.976488 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b9351-d25e-406e-9857-93a4b12395b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:56.977231 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4b9351-d25e-406e-9857-93a4b12395b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:56.985968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 234/459] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:49:56.991002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b9351-d25e-406e-9857-93a4b12395b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:56.992662 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4b9351-d25e-406e-9857-93a4b12395b0 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:57.011482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-1f4b9351-d25e-406e-9857-93a4b12395b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:49:57.011482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:57.011482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:57.011482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:57.011482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:57.011482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:57.011482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:57.011482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:57.011482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:57.011482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:57.011482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:57.011482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:57.011482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:49:57.011482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:49:57.011482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:49:57.016599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:49:57.016599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:57.016599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:57.016599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:57.016599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:57.016599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:57.016599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:57.016599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:57.016599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:57.016599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:57.016599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:57.016599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:57.016599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:57.016599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:57.016599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:57.016599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:57.016599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:57.017655 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:49:57.017655 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:49:57.017655 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:49:57.017655 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:57.017655 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 226/460] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:49:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:57.017949 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc30e94-1ce9-4631-8b4d-f7a24b75ffee None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:57.019892 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33374e30-8dda-4350-bad7-b8a2c9eacaab None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:57.020188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33374e30-8dda-4350-bad7-b8a2c9eacaab None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:57.020468 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33374e30-8dda-4350-bad7-b8a2c9eacaab None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:57.022001 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 227/461] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:57.025435 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33374e30-8dda-4350-bad7-b8a2c9eacaab None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:57.056774 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:57.126620 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:57.127930 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc30e94-1ce9-4631-8b4d-f7a24b75ffee None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:57.152102 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33374e30-8dda-4350-bad7-b8a2c9eacaab None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:57.176142 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160226e7-f4cb-4d69-a252-9ed0d7f462ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:57.177328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160226e7-f4cb-4d69-a252-9ed0d7f462ae None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:57.178236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160226e7-f4cb-4d69-a252-9ed0d7f462ae None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:57.178716 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160226e7-f4cb-4d69-a252-9ed0d7f462ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:57.190724 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160226e7-f4cb-4d69-a252-9ed0d7f462ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:57.192341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb40870-e927-4b09-83bc-643194572e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:57.192464 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160226e7-f4cb-4d69-a252-9ed0d7f462ae None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:57.193038 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb40870-e927-4b09-83bc-643194572e71 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:57.193325 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb40870-e927-4b09-83bc-643194572e71 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:57.193604 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb40870-e927-4b09-83bc-643194572e71 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:57.194332 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb40870-e927-4b09-83bc-643194572e71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:57.194639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb40870-e927-4b09-83bc-643194572e71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:57.196170 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb40870-e927-4b09-83bc-643194572e71 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:57.208281 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 228/462] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:57.209663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0205f2f-2f99-4a7d-8e3e-25967ec0ef62 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:57.209948 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0205f2f-2f99-4a7d-8e3e-25967ec0ef62 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:57.210229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0205f2f-2f99-4a7d-8e3e-25967ec0ef62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:57.212394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-160226e7-f4cb-4d69-a252-9ed0d7f462ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:49:57.212394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:57.212394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:57.212394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:57.212394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:57.212394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:57.212394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:57.212394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:57.212394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:57.212394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:57.212394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:57.212394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:57.212394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:49:57.212394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:49:57.212394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:49:57.213363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:49:57.213363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:57.213363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:57.213363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:57.213363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:57.213363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:57.213363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:57.213363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:57.213363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:57.213363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:57.213363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:57.213363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:57.213363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:57.213363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:57.213363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:57.213363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:57.213363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:57.214388 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:49:57.214388 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:49:57.214388 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:49:57.214388 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:49:57.214388 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 235/463] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:49:57.217590 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160226e7-f4cb-4d69-a252-9ed0d7f462ae None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:57.234489 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-d0205f2f-2f99-4a7d-8e3e-25967ec0ef62 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:57.235699 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-d0205f2f-2f99-4a7d-8e3e-25967ec0ef62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:57.304105 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 229/464] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:57.304992 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0205f2f-2f99-4a7d-8e3e-25967ec0ef62 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:57.324399 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:57.337668 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160226e7-f4cb-4d69-a252-9ed0d7f462ae None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:57.371928 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ec4c4-eb60-4d2f-8fa8-35700b55facb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:57.372597 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ec4c4-eb60-4d2f-8fa8-35700b55facb None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:57.372905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ec4c4-eb60-4d2f-8fa8-35700b55facb None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:57.373181 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6ec4c4-eb60-4d2f-8fa8-35700b55facb None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:57.373878 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ec4c4-eb60-4d2f-8fa8-35700b55facb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:57.375328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6ec4c4-eb60-4d2f-8fa8-35700b55facb None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:57.381783 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:57.404022 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0205f2f-2f99-4a7d-8e3e-25967ec0ef62 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:57.437405 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4842f2af-1746-448d-93bf-e50a84e46970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:57.438060 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842f2af-1746-448d-93bf-e50a84e46970 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:57.438347 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842f2af-1746-448d-93bf-e50a84e46970 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:57.438624 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4842f2af-1746-448d-93bf-e50a84e46970 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:57.439392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842f2af-1746-448d-93bf-e50a84e46970 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:57.439698 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842f2af-1746-448d-93bf-e50a84e46970 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:57.441153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4842f2af-1746-448d-93bf-e50a84e46970 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:57.453296 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 230/465] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:57.457522 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95160e-e8a2-486c-b04b-adef0759ec65 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:57.457522 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95160e-e8a2-486c-b04b-adef0759ec65 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:57.457522 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95160e-e8a2-486c-b04b-adef0759ec65 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:57.457522 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 231/466] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:57.457522 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95160e-e8a2-486c-b04b-adef0759ec65 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:57.482794 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 236/467] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 12:49:57 2022] POST /identity/v3/users => generated 246 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:49:57.485997 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ec4c4-eb60-4d2f-8fa8-35700b55facb None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:57.581196 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95160e-e8a2-486c-b04b-adef0759ec65 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:57.607392 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6ec4c4-eb60-4d2f-8fa8-35700b55facb None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:57.626079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb41e6f-ab95-4d77-8fc5-77ec0a43df7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:57.627020 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb41e6f-ab95-4d77-8fc5-77ec0a43df7c None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:57.627317 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb41e6f-ab95-4d77-8fc5-77ec0a43df7c None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:57.627587 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb41e6f-ab95-4d77-8fc5-77ec0a43df7c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:57.631430 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:57.641810 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb41e6f-ab95-4d77-8fc5-77ec0a43df7c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:57.643395 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb41e6f-ab95-4d77-8fc5-77ec0a43df7c None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:57.652207 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc2d05-db4f-4d2c-879d-5875d22811dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:57.661460 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc2d05-db4f-4d2c-879d-5875d22811dd None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:57.661460 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc2d05-db4f-4d2c-879d-5875d22811dd None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:57.661460 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15dc2d05-db4f-4d2c-879d-5875d22811dd None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:57.661460 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc2d05-db4f-4d2c-879d-5875d22811dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:57.661460 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15dc2d05-db4f-4d2c-879d-5875d22811dd None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:57.661981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-cdb41e6f-ab95-4d77-8fc5-77ec0a43df7c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:49:57.661981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:57.661981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:57.661981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:57.661981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:57.661981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:57.661981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:57.661981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:57.661981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:57.661981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:57.661981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:57.661981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:57.661981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:49:57.661981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:49:57.661981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:49:57.662760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:49:57.662760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:57.662760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:57.662760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:57.662760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:57.662760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:57.662760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:57.662760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:57.662760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:57.662760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:57.662760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:57.662760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:57.662760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:57.662760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:57.662760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:57.662760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:57.662760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:57.664581 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:49:57.664581 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:49:57.664581 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:49:57.664581 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:57.664581 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 232/468] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:57.665187 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13351755-3555-4ce6-8907-15bbead50179 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:57.665480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13351755-3555-4ce6-8907-15bbead50179 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:57.665819 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13351755-3555-4ce6-8907-15bbead50179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:57.682567 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-13351755-3555-4ce6-8907-15bbead50179 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:57.684611 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-13351755-3555-4ce6-8907-15bbead50179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:57.755229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 233/469] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:57.756077 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13351755-3555-4ce6-8907-15bbead50179 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:57.860864 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13351755-3555-4ce6-8907-15bbead50179 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:57.879215 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:57.896649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56004cd9-4222-47c0-82db-62722e67ac46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:57.897325 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56004cd9-4222-47c0-82db-62722e67ac46 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:57.897614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56004cd9-4222-47c0-82db-62722e67ac46 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:57.897898 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56004cd9-4222-47c0-82db-62722e67ac46 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:57.898680 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56004cd9-4222-47c0-82db-62722e67ac46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:57.899035 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56004cd9-4222-47c0-82db-62722e67ac46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:57.900418 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56004cd9-4222-47c0-82db-62722e67ac46 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:57.912076 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 234/470] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:49:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:49:57.912916 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56004cd9-4222-47c0-82db-62722e67ac46 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:57.964368 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:57.980664 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 237/471] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 12:49:57 2022] POST /identity/v3/users => generated 248 bytes in 490 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:49:57.980664 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc2d05-db4f-4d2c-879d-5875d22811dd None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:58.051808 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56004cd9-4222-47c0-82db-62722e67ac46 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:58.099227 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef859180-fdc6-4d1b-bb74-7582abd12cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:58.100151 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef859180-fdc6-4d1b-bb74-7582abd12cab None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:58.101038 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef859180-fdc6-4d1b-bb74-7582abd12cab None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:58.101441 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef859180-fdc6-4d1b-bb74-7582abd12cab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:58.113649 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15dc2d05-db4f-4d2c-879d-5875d22811dd None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:58.118089 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef859180-fdc6-4d1b-bb74-7582abd12cab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:58.119582 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef859180-fdc6-4d1b-bb74-7582abd12cab None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:58.139313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-ef859180-fdc6-4d1b-bb74-7582abd12cab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:49:58.139313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:49:58.139313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:49:58.139313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:49:58.139313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:49:58.139313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:49:58.139313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:49:58.139313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:49:58.139313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:49:58.139313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:49:58.139313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:49:58.139313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:49:58.139313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:49:58.139313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:49:58.139313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:49:58.141000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:49:58.141000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:49:58.141000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:49:58.141000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:49:58.141000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:49:58.141000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:49:58.141000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:49:58.141000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:49:58.141000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:49:58.141000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:49:58.141000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:49:58.141000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:49:58.141000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:49:58.141000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:49:58.141000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:49:58.141000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:49:58.141000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:49:58.141936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:49:58.141936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:49:58.141936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:49:58.141936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:49:58.141936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 235/472] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:49:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:49:58.146941 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef859180-fdc6-4d1b-bb74-7582abd12cab None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:58.170833 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dac4b4-944d-4699-8fc2-e9980c891a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:58.171969 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dac4b4-944d-4699-8fc2-e9980c891a04 None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:58.173100 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dac4b4-944d-4699-8fc2-e9980c891a04 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:58.173766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dac4b4-944d-4699-8fc2-e9980c891a04 None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:58.174975 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dac4b4-944d-4699-8fc2-e9980c891a04 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:58.177498 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dac4b4-944d-4699-8fc2-e9980c891a04 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:58.183625 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:58.260531 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef859180-fdc6-4d1b-bb74-7582abd12cab None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:58.306920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 238/473] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 12:49:57 2022] POST /identity/v3/users => generated 248 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:49:58.309676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6020a47-38f9-463d-87df-5b0e4ff90772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:58.310697 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6020a47-38f9-463d-87df-5b0e4ff90772 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:58.311219 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6020a47-38f9-463d-87df-5b0e4ff90772 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:58.311758 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6020a47-38f9-463d-87df-5b0e4ff90772 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:58.313386 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6020a47-38f9-463d-87df-5b0e4ff90772 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:49:58.313900 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6020a47-38f9-463d-87df-5b0e4ff90772 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:58.315560 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6020a47-38f9-463d-87df-5b0e4ff90772 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:58.331175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 236/474] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:49:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:49:58.336736 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dac4b4-944d-4699-8fc2-e9980c891a04 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:49:58.401072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:49:58.456742 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dac4b4-944d-4699-8fc2-e9980c891a04 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:49:58.498657 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a4b17c-7c38-447f-84b8-9ffeb8125365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:49:58.499374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4b17c-7c38-447f-84b8-9ffeb8125365 None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:58.499656 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4b17c-7c38-447f-84b8-9ffeb8125365 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:58.499929 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a4b17c-7c38-447f-84b8-9ffeb8125365 None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:58.500701 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4b17c-7c38-447f-84b8-9ffeb8125365 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:49:58.502163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a4b17c-7c38-447f-84b8-9ffeb8125365 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:49:58.587809 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 239/475] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 12:49:58 2022] POST /identity/v3/users => generated 249 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:49:59.855972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ecb16-4bb4-400b-b436-77b08f120bae None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:59.856491 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ecb16-4bb4-400b-b436-77b08f120bae None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:59.856569 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1ecb16-4bb4-400b-b436-77b08f120bae None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:59.858166 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 237/476] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:49:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:49:59.864279 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b232127-dc21-4d4d-8a5f-fe27abe8a20c None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:49:59.864754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b232127-dc21-4d4d-8a5f-fe27abe8a20c None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:49:59.864941 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b232127-dc21-4d4d-8a5f-fe27abe8a20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:49:59.883632 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-8b232127-dc21-4d4d-8a5f-fe27abe8a20c None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:49:59.884851 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-8b232127-dc21-4d4d-8a5f-fe27abe8a20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:49:59.960750 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 240/477] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:49:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:49:59.980668 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ecb16-4bb4-400b-b436-77b08f120bae None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:00.086736 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:00.097962 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1ecb16-4bb4-400b-b436-77b08f120bae None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:00.139369 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a8be6-87ae-44ab-bf9a-bdc0b5551e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:00.139369 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a8be6-87ae-44ab-bf9a-bdc0b5551e8c None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:00.139369 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a8be6-87ae-44ab-bf9a-bdc0b5551e8c None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:00.139369 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7a8be6-87ae-44ab-bf9a-bdc0b5551e8c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:00.152682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7a8be6-87ae-44ab-bf9a-bdc0b5551e8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:50:00.162922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-ff7a8be6-87ae-44ab-bf9a-bdc0b5551e8c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:00.162922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:00.162922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:00.162922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:00.162922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:00.162922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:00.162922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:00.162922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:00.162922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:00.162922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:00.162922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:00.162922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:00.162922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:50:00.162922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:50:00.162922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:50:00.162922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:50:00.163845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:50:00.163845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:50:00.163845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:50:00.163845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:50:00.163845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:00.163845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:00.163845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:00.163845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:00.163845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:00.163845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:00.163845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:00.163845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:00.163845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:00.163845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:00.163845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:00.163845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:00.164668 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:00.164668 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:00.164668 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:00.164668 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:00.164668 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:50:00.164668 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:50:00.164668 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:50:00.164668 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:50:00.164668 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:50:00.164668 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:50:00.164668 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:00.164668 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:00.164668 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 238/478] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 12:49:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:00.170284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b232127-dc21-4d4d-8a5f-fe27abe8a20c None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:00.215405 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:00.274337 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b232127-dc21-4d4d-8a5f-fe27abe8a20c None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:00.317398 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16741f9c-a659-416f-8eea-e79cde773de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:00.318090 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16741f9c-a659-416f-8eea-e79cde773de0 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:00.318374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16741f9c-a659-416f-8eea-e79cde773de0 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:00.318651 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16741f9c-a659-416f-8eea-e79cde773de0 None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:00.319415 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16741f9c-a659-416f-8eea-e79cde773de0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:00.319722 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16741f9c-a659-416f-8eea-e79cde773de0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:00.321253 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16741f9c-a659-416f-8eea-e79cde773de0 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:00.335555 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 241/479] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 12:50:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:00.336984 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a8be6-87ae-44ab-bf9a-bdc0b5551e8c None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:00.446047 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7a8be6-87ae-44ab-bf9a-bdc0b5551e8c None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:00.469670 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb67b1b-f90a-4dfa-a265-2e14daf5cdfb None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:00.470308 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb67b1b-f90a-4dfa-a265-2e14daf5cdfb None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:00.470793 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb67b1b-f90a-4dfa-a265-2e14daf5cdfb None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:00.472705 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 242/480] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:00.478325 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cdd39-a188-4541-b879-4cbb1137f093 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:00.478908 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cdd39-a188-4541-b879-4cbb1137f093 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:00.479389 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cdd39-a188-4541-b879-4cbb1137f093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:00.484833 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb03d9-532d-40d1-84a7-06c2f0c8a833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:00.485641 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb03d9-532d-40d1-84a7-06c2f0c8a833 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:00.485918 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb03d9-532d-40d1-84a7-06c2f0c8a833 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:00.486200 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9eb03d9-532d-40d1-84a7-06c2f0c8a833 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:00.498003 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb03d9-532d-40d1-84a7-06c2f0c8a833 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:00.499534 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9eb03d9-532d-40d1-84a7-06c2f0c8a833 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:00.501742 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-9a1cdd39-a188-4541-b879-4cbb1137f093 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:00.503538 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-9a1cdd39-a188-4541-b879-4cbb1137f093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:00.518192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-d9eb03d9-532d-40d1-84a7-06c2f0c8a833 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:00.518192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:00.518192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:00.518192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:00.518192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:00.518192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:00.518192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:00.518192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:00.518192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:00.518192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:00.518192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:00.518192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:00.518192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:00.518192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:00.518192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:00.519291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:00.519291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:00.519291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:00.519291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:00.519291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:00.519291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:00.519291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:00.519291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:00.519291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:00.519291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:00.519291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:00.519291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:00.519291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:00.519291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:00.519291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:00.519291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:00.519291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:00.520143 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:00.520143 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:00.520143 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:00.520143 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:00.524104 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 239/481] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:00.525522 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb03d9-532d-40d1-84a7-06c2f0c8a833 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:00.535445 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:00.611069 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 243/482] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:50:00.633707 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cdd39-a188-4541-b879-4cbb1137f093 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:00.651667 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9eb03d9-532d-40d1-84a7-06c2f0c8a833 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:00.762064 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:00.769697 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339f7901-e5b2-4ee4-aa39-73cafdbd7baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:00.773142 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f7901-e5b2-4ee4-aa39-73cafdbd7baf None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:00.773142 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f7901-e5b2-4ee4-aa39-73cafdbd7baf None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:00.773142 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339f7901-e5b2-4ee4-aa39-73cafdbd7baf None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:00.773142 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f7901-e5b2-4ee4-aa39-73cafdbd7baf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:00.773142 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f7901-e5b2-4ee4-aa39-73cafdbd7baf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:00.773568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339f7901-e5b2-4ee4-aa39-73cafdbd7baf None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:00.788236 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 240/483] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:00.794579 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1151ae6-4a25-4203-84ed-5dedded4dce4 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:00.794875 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1151ae6-4a25-4203-84ed-5dedded4dce4 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:00.795162 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1151ae6-4a25-4203-84ed-5dedded4dce4 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:00.797529 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 241/484] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:00.798286 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1151ae6-4a25-4203-84ed-5dedded4dce4 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:00.855181 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cdd39-a188-4541-b879-4cbb1137f093 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:00.875672 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:00.903244 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5e2534-0bc8-4bd7-a305-dbc91fb933c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:00.904491 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e2534-0bc8-4bd7-a305-dbc91fb933c4 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:00.904875 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e2534-0bc8-4bd7-a305-dbc91fb933c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:00.905462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5e2534-0bc8-4bd7-a305-dbc91fb933c4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:00.917209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1151ae6-4a25-4203-84ed-5dedded4dce4 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:00.920383 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5e2534-0bc8-4bd7-a305-dbc91fb933c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:50:00.930004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-4d5e2534-0bc8-4bd7-a305-dbc91fb933c4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:00.930004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:00.930004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:00.930004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:00.930004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:00.930004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:00.930004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:00.930004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:00.930004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:00.930004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:00.930004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:00.930004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:00.930004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:50:00.930004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:50:00.930004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:50:00.930004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:50:00.930892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:50:00.930892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:50:00.930892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:50:00.930892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:50:00.930892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:00.930892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:00.930892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:00.930892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:00.930892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:00.930892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:00.930892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:00.930892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:00.930892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:00.930892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:00.930892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:00.930892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:00.931756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:00.931756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:00.931756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:00.931756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:00.931756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:50:00.931756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:50:00.931756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:50:00.931756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:50:00.931756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:50:00.931756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:50:00.931756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:00.931756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:00.932373 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 244/485] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 12:50:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:00.933201 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0f73c-0269-4410-8c32-752943910abb None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:00.933492 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0f73c-0269-4410-8c32-752943910abb None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:00.933755 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b0f73c-0269-4410-8c32-752943910abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:00.953983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-08b0f73c-0269-4410-8c32-752943910abb None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:00.955268 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-08b0f73c-0269-4410-8c32-752943910abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:00.966806 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1220cb7-4505-4eb0-90a7-12c3e1392ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:00.967618 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1220cb7-4505-4eb0-90a7-12c3e1392ef9 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:00.967901 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1220cb7-4505-4eb0-90a7-12c3e1392ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:00.968236 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1220cb7-4505-4eb0-90a7-12c3e1392ef9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:00.976066 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1220cb7-4505-4eb0-90a7-12c3e1392ef9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:00.977600 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1220cb7-4505-4eb0-90a7-12c3e1392ef9 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:00.994273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-f1220cb7-4505-4eb0-90a7-12c3e1392ef9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 12:50:00.994273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:00.994273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:00.994273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:00.994273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:00.994273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:00.994273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:00.994273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:00.994273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:00.994273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:00.994273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:00.994273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:00.994273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:50:00.994273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:50:00.994273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:50:00.994273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:50:00.995306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:00.995306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:00.995306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:50:00.995306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:00.995306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:50:00.995306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:00.995306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:00.995306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:00.995306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:00.995306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:00.995306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:00.995306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:00.995306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:00.995306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:00.995306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:00.995306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:00.995306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:00.995306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:00.996210 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:00.996210 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:00.996210 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:50:00.996210 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:50:00.996210 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:50:00.996210 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:50:00.996210 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:50:00.996210 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:50:00.996210 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 12:50:00.996210 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:00.996210 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 242/486] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 14 12:50:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:00.996820 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1220cb7-4505-4eb0-90a7-12c3e1392ef9 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:01.032047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 245/487] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:50:01.033324 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11e2ac-5fbc-433c-ac30-b41508fe51e1 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:01.033617 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11e2ac-5fbc-433c-ac30-b41508fe51e1 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:01.033917 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f11e2ac-5fbc-433c-ac30-b41508fe51e1 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:01.035185 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 246/488] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:01.035871 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11e2ac-5fbc-433c-ac30-b41508fe51e1 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:01.063383 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:01.114119 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1220cb7-4505-4eb0-90a7-12c3e1392ef9 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:01.137618 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:01.146068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f11e2ac-5fbc-433c-ac30-b41508fe51e1 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:01.149637 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb6f3fa-1822-4a65-9b93-846a173eb9a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:01.150304 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6f3fa-1822-4a65-9b93-846a173eb9a1 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:01.150591 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6f3fa-1822-4a65-9b93-846a173eb9a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:01.150874 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb6f3fa-1822-4a65-9b93-846a173eb9a1 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:01.151625 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6f3fa-1822-4a65-9b93-846a173eb9a1 None admin] RBAC: Adding query filter params (name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:01.151934 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6f3fa-1822-4a65-9b93-846a173eb9a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:01.153361 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb6f3fa-1822-4a65-9b93-846a173eb9a1 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:01.162396 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 243/489] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 12:50:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:01.162396 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a5a26-1899-43a4-af38-69beb5a0a744 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:01.162396 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a5a26-1899-43a4-af38-69beb5a0a744 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:01.162396 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267a5a26-1899-43a4-af38-69beb5a0a744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:01.185174 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf8b70-5c84-46aa-b0de-ea61ab3ae1f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:01.185862 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf8b70-5c84-46aa-b0de-ea61ab3ae1f0 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:01.186143 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf8b70-5c84-46aa-b0de-ea61ab3ae1f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:01.186418 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf8b70-5c84-46aa-b0de-ea61ab3ae1f0 None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:01.186553 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-267a5a26-1899-43a4-af38-69beb5a0a744 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:01.187812 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf8b70-5c84-46aa-b0de-ea61ab3ae1f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:01.188123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf8b70-5c84-46aa-b0de-ea61ab3ae1f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:01.189123 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-267a5a26-1899-43a4-af38-69beb5a0a744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:01.189594 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf8b70-5c84-46aa-b0de-ea61ab3ae1f0 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:01.227512 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 247/490] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 14 12:50:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:01.228366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf8b70-5c84-46aa-b0de-ea61ab3ae1f0 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:01.260614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 244/491] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:50:01.261495 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a5a26-1899-43a4-af38-69beb5a0a744 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:01.313475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:01.334340 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf8b70-5c84-46aa-b0de-ea61ab3ae1f0 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:01.363428 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267a5a26-1899-43a4-af38-69beb5a0a744 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:01.370632 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fb7c1-e5fa-4466-abb2-4f0669d4cc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:01.371429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fb7c1-e5fa-4466-abb2-4f0669d4cc43 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:01.371707 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fb7c1-e5fa-4466-abb2-4f0669d4cc43 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:01.371982 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1fb7c1-e5fa-4466-abb2-4f0669d4cc43 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:01.378662 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:01.383164 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1fb7c1-e5fa-4466-abb2-4f0669d4cc43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:50:01.390921 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-cc1fb7c1-e5fa-4466-abb2-4f0669d4cc43 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:01.390921 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:01.390921 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:01.390921 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:01.390921 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:01.390921 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:01.390921 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:01.390921 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:01.390921 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:01.390921 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:01.390921 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:01.390921 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:01.390921 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:50:01.390921 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:50:01.390921 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:50:01.390921 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:50:01.392003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:50:01.392003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:50:01.392003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:50:01.392003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:50:01.392003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:01.392003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:01.392003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:01.392003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:01.392003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:01.392003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:01.392003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:01.392003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:01.392003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:01.392003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:01.392003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:01.392003 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:01.393163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:01.393163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:01.393163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:01.393163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:01.393163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:50:01.393163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:50:01.393163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:50:01.393163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:50:01.393163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:50:01.393163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:50:01.393163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:01.393163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:01.393163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 248/492] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 12:50:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:01.393163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fb7c1-e5fa-4466-abb2-4f0669d4cc43 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:01.402222 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6831ec4-13f5-4e9f-945e-011872c99eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:01.403099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6831ec4-13f5-4e9f-945e-011872c99eed None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:01.403360 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6831ec4-13f5-4e9f-945e-011872c99eed None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:01.403633 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6831ec4-13f5-4e9f-945e-011872c99eed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:01.414347 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6831ec4-13f5-4e9f-945e-011872c99eed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:01.415790 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6831ec4-13f5-4e9f-945e-011872c99eed None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:01.434825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-a6831ec4-13f5-4e9f-945e-011872c99eed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:01.434825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:01.434825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:01.434825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:01.434825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:01.434825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:01.434825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:01.434825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:01.434825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:01.434825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:01.434825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:01.434825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:01.434825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:01.434825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:01.434825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:01.435840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:01.435840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:01.435840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:01.435840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:01.435840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:01.435840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:01.435840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:01.435840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:01.435840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:01.435840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:01.435840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:01.435840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:01.435840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:01.435840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:01.435840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:01.435840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:01.435840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:01.436946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:01.436946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:01.436946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:01.436946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:01.436946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 245/493] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:01.436946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6831ec4-13f5-4e9f-945e-011872c99eed None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:01.501615 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1fb7c1-e5fa-4466-abb2-4f0669d4cc43 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:01.536199 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c8b4-8260-41e9-97d1-57d7538cffe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:01.536887 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c8b4-8260-41e9-97d1-57d7538cffe7 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:01.537174 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c8b4-8260-41e9-97d1-57d7538cffe7 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:01.537456 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8364c8b4-8260-41e9-97d1-57d7538cffe7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:01.540108 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6831ec4-13f5-4e9f-945e-011872c99eed None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:01.550488 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:01.575756 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73735ff9-af69-45d8-9ffc-1e1e94378afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:01.576467 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73735ff9-af69-45d8-9ffc-1e1e94378afd None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:01.576793 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73735ff9-af69-45d8-9ffc-1e1e94378afd None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:01.577229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73735ff9-af69-45d8-9ffc-1e1e94378afd None admin] PATH_INFO: `/v3/roles/service` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:01.588361 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73735ff9-af69-45d8-9ffc-1e1e94378afd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:50:01.596945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-73735ff9-af69-45d8-9ffc-1e1e94378afd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:01.596945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:01.596945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:01.596945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:01.596945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:01.596945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:01.596945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:01.596945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:01.596945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:01.596945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:01.596945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:01.596945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:01.596945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:50:01.596945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:50:01.596945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:50:01.596945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:50:01.597939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:50:01.597939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:50:01.597939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:50:01.597939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:50:01.597939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:01.597939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:01.597939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:01.597939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:01.597939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:01.597939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:01.597939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:01.597939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:01.597939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:01.597939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:01.597939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:01.597939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:01.598720 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:01.598720 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:01.598720 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:01.598720 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:01.598720 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:50:01.598720 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:50:01.598720 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:50:01.598720 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:50:01.598720 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:50:01.598720 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:50:01.598720 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:01.598720 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:01.598720 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 246/494] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 12:50:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:01.599371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73735ff9-af69-45d8-9ffc-1e1e94378afd None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:01.613702 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364c8b4-8260-41e9-97d1-57d7538cffe7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:01.615231 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8364c8b4-8260-41e9-97d1-57d7538cffe7 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:01.628757 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:01.704181 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73735ff9-af69-45d8-9ffc-1e1e94378afd None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:01.716745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 249/495] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:50:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:50:01.717795 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c8b4-8260-41e9-97d1-57d7538cffe7 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:01.743456 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bca99-a846-4c51-bf69-c12c71b47489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:01.744111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bca99-a846-4c51-bf69-c12c71b47489 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:01.744390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bca99-a846-4c51-bf69-c12c71b47489 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:01.744687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bca99-a846-4c51-bf69-c12c71b47489 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:01.745429 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bca99-a846-4c51-bf69-c12c71b47489 None admin] RBAC: Adding query filter params (name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:01.745730 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bca99-a846-4c51-bf69-c12c71b47489 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:01.747107 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5bca99-a846-4c51-bf69-c12c71b47489 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:01.755906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 247/496] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 12:50:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:01.756700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bca99-a846-4c51-bf69-c12c71b47489 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:01.761485 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:01.818889 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8364c8b4-8260-41e9-97d1-57d7538cffe7 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:01.843429 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:01.852814 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fda09-5d80-4b47-a4ab-fa0dabd36e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:01.853477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fda09-5d80-4b47-a4ab-fa0dabd36e6a None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:01.853765 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fda09-5d80-4b47-a4ab-fa0dabd36e6a None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:01.857966 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fda09-5d80-4b47-a4ab-fa0dabd36e6a None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:01.857966 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fda09-5d80-4b47-a4ab-fa0dabd36e6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:01.857966 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fda09-5d80-4b47-a4ab-fa0dabd36e6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:01.858200 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bca99-a846-4c51-bf69-c12c71b47489 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:01.858297 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fda09-5d80-4b47-a4ab-fa0dabd36e6a None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:01.875112 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 250/497] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:01.875943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fda09-5d80-4b47-a4ab-fa0dabd36e6a None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:01.889455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70bf03-5c25-425a-ae35-043d73f408a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:01.890147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70bf03-5c25-425a-ae35-043d73f408a3 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:01.890675 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70bf03-5c25-425a-ae35-043d73f408a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:01.890675 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f70bf03-5c25-425a-ae35-043d73f408a3 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:01.891421 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70bf03-5c25-425a-ae35-043d73f408a3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:01.891726 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70bf03-5c25-425a-ae35-043d73f408a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:01.893126 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f70bf03-5c25-425a-ae35-043d73f408a3 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:01.905649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 248/498] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 12:50:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:01.905649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70bf03-5c25-425a-ae35-043d73f408a3 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:01.978505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fda09-5d80-4b47-a4ab-fa0dabd36e6a None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:01.980157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:02.006886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f70bf03-5c25-425a-ae35-043d73f408a3 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:02.012930 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102eaff-b956-41fd-b49a-c3decd2d274f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:02.013728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102eaff-b956-41fd-b49a-c3decd2d274f None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:02.014012 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102eaff-b956-41fd-b49a-c3decd2d274f None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:02.014286 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a102eaff-b956-41fd-b49a-c3decd2d274f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:02.024910 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102eaff-b956-41fd-b49a-c3decd2d274f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:02.026396 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a102eaff-b956-41fd-b49a-c3decd2d274f None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:02.040320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd127b5-795e-4004-bda2-fd50a62b58bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:02.041140 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd127b5-795e-4004-bda2-fd50a62b58bd None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:02.041427 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd127b5-795e-4004-bda2-fd50a62b58bd None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:02.041703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd127b5-795e-4004-bda2-fd50a62b58bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:02.044125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-a102eaff-b956-41fd-b49a-c3decd2d274f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:02.044125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:02.044125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:02.044125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:02.044125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:02.044125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:02.044125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:02.044125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:02.044125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:02.044125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:02.044125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:02.044125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:02.044125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:02.044125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:02.044125 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:02.045176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:02.045176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:02.045176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:02.045176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:02.045176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:02.045176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:02.045176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:02.045176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:02.045176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:02.045176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:02.045176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:02.045176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:02.045176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:02.045176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:02.045176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:02.045176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:02.045176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:02.047145 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:02.047145 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:02.047145 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:02.047145 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:02.047145 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 251/499] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:02.047145 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102eaff-b956-41fd-b49a-c3decd2d274f None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:02.055011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd127b5-795e-4004-bda2-fd50a62b58bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:02.056547 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd127b5-795e-4004-bda2-fd50a62b58bd None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:02.074174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-ddd127b5-795e-4004-bda2-fd50a62b58bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:02.074174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:02.074174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:02.074174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:02.074174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:02.074174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:02.074174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:02.074174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:02.074174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:02.074174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:02.074174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:02.074174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:02.074174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:02.074174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:02.074174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:02.075175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:02.075175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:02.075175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:02.075175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:02.075175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:02.075175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:02.075175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:02.075175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:02.075175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:02.075175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:02.075175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:02.075175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:02.075175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:02.075175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:02.075175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:02.075175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:02.075175 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:02.081287 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:02.081287 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:02.081287 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:02.081287 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:02.081287 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 249/500] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:02.081287 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd127b5-795e-4004-bda2-fd50a62b58bd None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:02.082377 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:02.157277 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a102eaff-b956-41fd-b49a-c3decd2d274f None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:02.183239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd127b5-795e-4004-bda2-fd50a62b58bd None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:02.191839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280bca9-4cbb-41ae-84ea-0fc0d362211c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:02.192650 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280bca9-4cbb-41ae-84ea-0fc0d362211c None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:02.192950 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280bca9-4cbb-41ae-84ea-0fc0d362211c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:02.193248 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280bca9-4cbb-41ae-84ea-0fc0d362211c None admin] PATH_INFO: `/v3/users/glance` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:02.200919 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280bca9-4cbb-41ae-84ea-0fc0d362211c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:02.202926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280bca9-4cbb-41ae-84ea-0fc0d362211c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:02.218626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-5280bca9-4cbb-41ae-84ea-0fc0d362211c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 12:50:02.218626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:02.218626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:02.218626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:02.218626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:02.218626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:02.218626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:02.218626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:02.218626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:02.218626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:02.218626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:02.218626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:02.218626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:50:02.218626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:50:02.218626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:50:02.218626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:50:02.219580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:02.219580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:02.219580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:50:02.219580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:02.219580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:50:02.219580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:02.219580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:02.219580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:02.219580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:02.219580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:02.219580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:02.219580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:02.219580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:02.219580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:02.219580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:02.219580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:02.219580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:02.219580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:02.220466 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:02.220466 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:02.220466 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:50:02.220466 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:50:02.220466 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:50:02.220466 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:50:02.220466 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:50:02.220466 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:50:02.220466 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 12:50:02.220466 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:02.221679 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1889f-1f21-4847-b616-2786df32d9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:02.221679 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1889f-1f21-4847-b616-2786df32d9b6 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:02.221884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 252/501] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:50:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:02.221975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1889f-1f21-4847-b616-2786df32d9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:02.221975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea1889f-1f21-4847-b616-2786df32d9b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:02.222129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280bca9-4cbb-41ae-84ea-0fc0d362211c None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:02.236922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1889f-1f21-4847-b616-2786df32d9b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:02.237829 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:02.238392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea1889f-1f21-4847-b616-2786df32d9b6 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:02.256455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-8ea1889f-1f21-4847-b616-2786df32d9b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:02.256455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:02.256455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:02.256455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:02.256455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:02.256455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:02.256455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:02.256455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:02.256455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:02.256455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:02.256455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:02.256455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:02.256455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:02.256455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:02.256455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:02.257385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:02.257385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:02.257385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:02.257385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:02.257385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:02.257385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:02.257385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:02.257385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:02.257385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:02.257385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:02.257385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:02.257385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:02.257385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:02.257385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:02.257385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:02.257385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:02.257385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:02.262754 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:02.262754 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:02.262754 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:02.262754 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:02.262754 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 250/502] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:02.262754 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1889f-1f21-4847-b616-2786df32d9b6 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:02.314133 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:02.323644 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280bca9-4cbb-41ae-84ea-0fc0d362211c None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:02.360827 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a935a-3efb-44e0-ac01-f7d3104dd713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:02.361491 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a935a-3efb-44e0-ac01-f7d3104dd713 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:02.361769 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a935a-3efb-44e0-ac01-f7d3104dd713 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:02.362041 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1a935a-3efb-44e0-ac01-f7d3104dd713 None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:02.362758 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a935a-3efb-44e0-ac01-f7d3104dd713 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:02.363060 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a935a-3efb-44e0-ac01-f7d3104dd713 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:02.364573 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1a935a-3efb-44e0-ac01-f7d3104dd713 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:02.367948 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea1889f-1f21-4847-b616-2786df32d9b6 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:02.382197 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 253/503] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:02.383092 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a935a-3efb-44e0-ac01-f7d3104dd713 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:02.402511 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef31b0d-4327-4733-b3f5-e34d36537a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:02.403169 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef31b0d-4327-4733-b3f5-e34d36537a69 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:02.403449 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef31b0d-4327-4733-b3f5-e34d36537a69 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:02.403721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef31b0d-4327-4733-b3f5-e34d36537a69 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:02.404428 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef31b0d-4327-4733-b3f5-e34d36537a69 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:02.404752 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef31b0d-4327-4733-b3f5-e34d36537a69 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:02.406148 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef31b0d-4327-4733-b3f5-e34d36537a69 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:02.417780 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 251/504] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:02.418600 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef31b0d-4327-4733-b3f5-e34d36537a69 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:02.463349 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:02.487475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1a935a-3efb-44e0-ac01-f7d3104dd713 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:02.517617 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef31b0d-4327-4733-b3f5-e34d36537a69 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:02.522008 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ee65c-9947-4a12-ab74-724d7b71a59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:02.522670 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ee65c-9947-4a12-ab74-724d7b71a59c None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:02.522950 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ee65c-9947-4a12-ab74-724d7b71a59c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:02.523219 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ee65c-9947-4a12-ab74-724d7b71a59c None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:02.524043 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ee65c-9947-4a12-ab74-724d7b71a59c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:02.524349 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ee65c-9947-4a12-ab74-724d7b71a59c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:02.525828 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ee65c-9947-4a12-ab74-724d7b71a59c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:02.531456 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:02.542630 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 254/505] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jul 14 12:50:02 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:02.545244 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ee65c-9947-4a12-ab74-724d7b71a59c None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:02.552240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63925d-4063-4a1d-8558-42ce6e99a084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:02.552934 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63925d-4063-4a1d-8558-42ce6e99a084 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:02.553223 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63925d-4063-4a1d-8558-42ce6e99a084 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:02.553501 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63925d-4063-4a1d-8558-42ce6e99a084 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:02.554226 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63925d-4063-4a1d-8558-42ce6e99a084 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:02.554534 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63925d-4063-4a1d-8558-42ce6e99a084 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:02.555890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63925d-4063-4a1d-8558-42ce6e99a084 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:02.568479 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 252/506] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:02.569174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63925d-4063-4a1d-8558-42ce6e99a084 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:02.642852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ee65c-9947-4a12-ab74-724d7b71a59c None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:02.668136 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63925d-4063-4a1d-8558-42ce6e99a084 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:02.675828 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:02.680784 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2921c2-d43d-4299-bba7-7be4a31b440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:02.681645 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2921c2-d43d-4299-bba7-7be4a31b440f None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:02.682014 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2921c2-d43d-4299-bba7-7be4a31b440f None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:02.682353 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2921c2-d43d-4299-bba7-7be4a31b440f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:02.689232 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2921c2-d43d-4299-bba7-7be4a31b440f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:02.690701 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2921c2-d43d-4299-bba7-7be4a31b440f None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:02.705860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-6d2921c2-d43d-4299-bba7-7be4a31b440f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:02.705860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:02.705860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:02.705860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:02.705860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:02.705860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:02.705860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:02.705860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:02.705860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:02.705860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:02.705860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:02.705860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:02.705860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:50:02.705860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:50:02.705860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:50:02.706874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:50:02.706874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:02.706874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:02.706874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:02.706874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:02.706874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:02.706874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:02.706874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:02.706874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:02.706874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:02.706874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:02.706874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:02.706874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:02.706874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:02.706874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:02.706874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:02.706874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:02.707742 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:50:02.707742 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:50:02.707742 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:50:02.707742 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:50:02.707742 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:50:02.707742 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:50:02.707742 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:02.707742 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:02.707742 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 255/507] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:02.708344 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2921c2-d43d-4299-bba7-7be4a31b440f None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:02.726369 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e5269-6772-4c2c-b640-7942ba2499da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:02.727453 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e5269-6772-4c2c-b640-7942ba2499da None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:02.727739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e5269-6772-4c2c-b640-7942ba2499da None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:02.728016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096e5269-6772-4c2c-b640-7942ba2499da None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:02.735704 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e5269-6772-4c2c-b640-7942ba2499da None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:02.737180 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096e5269-6772-4c2c-b640-7942ba2499da None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:02.751256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-096e5269-6772-4c2c-b640-7942ba2499da None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 12:50:02.751256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:02.751256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:02.751256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:02.751256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:02.751256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:02.751256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:02.751256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:02.751256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:02.751256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:02.751256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:02.751256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:02.751256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:50:02.751256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:50:02.751256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:50:02.751256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:50:02.752188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:02.752188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:02.752188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:50:02.752188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:02.752188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:50:02.752188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:02.752188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:02.752188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:02.752188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:02.752188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:02.752188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:02.752188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:02.752188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:02.752188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:02.752188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:02.752188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:02.752188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:02.752188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:02.753302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:02.753302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:02.753302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:50:02.753302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:50:02.753302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:50:02.753302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:50:02.753302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:50:02.753302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:50:02.753302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 12:50:02.753302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:02.753302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 253/508] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:50:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:02.753302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e5269-6772-4c2c-b640-7942ba2499da None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:02.789528 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:02.817535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2921c2-d43d-4299-bba7-7be4a31b440f None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:02.858550 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cbb5e-2ae2-4a73-bcef-83d0f0ecbec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:02.858776 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096e5269-6772-4c2c-b640-7942ba2499da None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:02.861075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cbb5e-2ae2-4a73-bcef-83d0f0ecbec2 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:02.861368 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cbb5e-2ae2-4a73-bcef-83d0f0ecbec2 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:02.862079 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cbb5e-2ae2-4a73-bcef-83d0f0ecbec2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:02.898834 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339bf47-1a5e-4e3a-8b8c-67196313495d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:02.899545 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339bf47-1a5e-4e3a-8b8c-67196313495d None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:02.899829 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339bf47-1a5e-4e3a-8b8c-67196313495d None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:02.900101 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3339bf47-1a5e-4e3a-8b8c-67196313495d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:02.908341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339bf47-1a5e-4e3a-8b8c-67196313495d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:02.909948 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3339bf47-1a5e-4e3a-8b8c-67196313495d None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:02.922582 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:02.923839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-3339bf47-1a5e-4e3a-8b8c-67196313495d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 12:50:02.923839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:02.923839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:02.923839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:02.923839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:02.923839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:02.923839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:02.923839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:02.923839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:02.923839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:02.923839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:02.923839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:02.923839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:50:02.923839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:50:02.923839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:50:02.923839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:50:02.924946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:02.924946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:02.924946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:50:02.924946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:02.924946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:50:02.924946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:02.924946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:02.924946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:02.924946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:02.924946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:02.924946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:02.924946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:02.924946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:02.924946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:02.924946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:02.924946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:02.924946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:02.924946 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:02.926239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:02.926239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:02.926239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:50:02.926239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:50:02.926239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:50:02.926239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:50:02.926239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:50:02.926239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:50:02.926239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 12:50:02.926239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:02.926239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 254/509] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 12:50:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:02.926239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339bf47-1a5e-4e3a-8b8c-67196313495d None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:02.935400 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cbb5e-2ae2-4a73-bcef-83d0f0ecbec2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:02.937423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cbb5e-2ae2-4a73-bcef-83d0f0ecbec2 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:03.019966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:03.026684 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3339bf47-1a5e-4e3a-8b8c-67196313495d None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:03.042147 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 256/510] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:50:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:50:03.043099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cbb5e-2ae2-4a73-bcef-83d0f0ecbec2 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:03.073050 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d84ae6-9dbf-4914-b8e0-223262849c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:03.073708 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d84ae6-9dbf-4914-b8e0-223262849c93 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:03.073998 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d84ae6-9dbf-4914-b8e0-223262849c93 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:03.074274 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d84ae6-9dbf-4914-b8e0-223262849c93 None admin] PATH_INFO: `/v3/projects` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:03.075068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d84ae6-9dbf-4914-b8e0-223262849c93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:03.075381 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d84ae6-9dbf-4914-b8e0-223262849c93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:03.076843 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d84ae6-9dbf-4914-b8e0-223262849c93 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:03.096527 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 255/511] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:50:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:03.097399 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d84ae6-9dbf-4914-b8e0-223262849c93 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:03.142858 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:03.151516 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cbb5e-2ae2-4a73-bcef-83d0f0ecbec2 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:03.189567 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6740a9-455a-4ccd-94c6-213614349d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:03.190237 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6740a9-455a-4ccd-94c6-213614349d31 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:03.190523 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6740a9-455a-4ccd-94c6-213614349d31 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:03.190801 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6740a9-455a-4ccd-94c6-213614349d31 None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:03.191742 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6740a9-455a-4ccd-94c6-213614349d31 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:03.192061 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6740a9-455a-4ccd-94c6-213614349d31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:03.193540 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6740a9-455a-4ccd-94c6-213614349d31 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:03.200128 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d84ae6-9dbf-4914-b8e0-223262849c93 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:03.211643 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 257/512] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jul 14 12:50:03 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:03.215098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6740a9-455a-4ccd-94c6-213614349d31 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:03.235840 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6d8fa-86b6-4c2d-bd39-c2379691f60c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:03.236591 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6d8fa-86b6-4c2d-bd39-c2379691f60c None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:03.236891 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6d8fa-86b6-4c2d-bd39-c2379691f60c None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:03.237170 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce6d8fa-86b6-4c2d-bd39-c2379691f60c None admin] PATH_INFO: `/v3/users` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:03.238019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6d8fa-86b6-4c2d-bd39-c2379691f60c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:03.238340 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6d8fa-86b6-4c2d-bd39-c2379691f60c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:03.239739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce6d8fa-86b6-4c2d-bd39-c2379691f60c None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:03.277069 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 256/513] 10.222.0.40 () {56 vars in 1139 bytes} [Thu Jul 14 12:50:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:03.277907 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6d8fa-86b6-4c2d-bd39-c2379691f60c None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:03.293172 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:03.313268 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6740a9-455a-4ccd-94c6-213614349d31 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:03.347082 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aebab7-596d-40db-bd4e-748123d51b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:03.347868 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aebab7-596d-40db-bd4e-748123d51b47 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:03.348151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aebab7-596d-40db-bd4e-748123d51b47 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:03.348426 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90aebab7-596d-40db-bd4e-748123d51b47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:03.359531 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aebab7-596d-40db-bd4e-748123d51b47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:03.361044 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90aebab7-596d-40db-bd4e-748123d51b47 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:03.379707 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce6d8fa-86b6-4c2d-bd39-c2379691f60c None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:03.379897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-90aebab7-596d-40db-bd4e-748123d51b47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:03.379897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:03.379897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:03.379897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:03.379897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:03.379897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:03.379897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:03.379897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:03.379897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:03.379897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:03.379897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:03.379897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:03.379897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:03.379897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:03.379897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:03.380974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:03.380974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:03.380974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:03.380974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:03.380974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:03.380974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:03.380974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:03.380974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:03.380974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:03.380974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:03.380974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:03.380974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:03.380974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:03.380974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:03.380974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:03.380974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:03.380974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:03.381829 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:03.381829 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:03.381829 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:03.381829 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:03.381829 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 258/514] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:03.382095 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aebab7-596d-40db-bd4e-748123d51b47 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:03.384565 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:03.414669 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666f6eb-893b-49b6-a1bf-2cd65956e4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:03.415265 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666f6eb-893b-49b6-a1bf-2cd65956e4ad None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:03.415531 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666f6eb-893b-49b6-a1bf-2cd65956e4ad None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:03.415806 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f666f6eb-893b-49b6-a1bf-2cd65956e4ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:03.416655 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666f6eb-893b-49b6-a1bf-2cd65956e4ad None admin] RBAC: Adding query filter params (role.id=f38b25010c404af5bbde51980f7e8dec, scope.project.id=2a58a74d443e40a782112277c58028b6, user.id=1faa19de04744a4084a9c60c4af64f3e) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:03.416972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666f6eb-893b-49b6-a1bf-2cd65956e4ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:03.418409 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f666f6eb-893b-49b6-a1bf-2cd65956e4ad None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:03.424313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 257/515] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:50:03 2022] GET /identity/v3/role_assignments?user.id=1faa19de04744a4084a9c60c4af64f3e&scope.project.id=2a58a74d443e40a782112277c58028b6&role.id=f38b25010c404af5bbde51980f7e8dec => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:03.425165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666f6eb-893b-49b6-a1bf-2cd65956e4ad None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:03.492283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90aebab7-596d-40db-bd4e-748123d51b47 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:03.513973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:03.530286 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7202c-e91f-460b-bb8f-8e9167596763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:03.530980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7202c-e91f-460b-bb8f-8e9167596763 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:03.531265 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7202c-e91f-460b-bb8f-8e9167596763 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:03.531542 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7202c-e91f-460b-bb8f-8e9167596763 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:03.538369 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f666f6eb-893b-49b6-a1bf-2cd65956e4ad None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:03.582958 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9731f-25a9-4f62-99b0-b6d9c994595e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:03.583701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9731f-25a9-4f62-99b0-b6d9c994595e None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:03.584159 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9731f-25a9-4f62-99b0-b6d9c994595e None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:03.584436 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9731f-25a9-4f62-99b0-b6d9c994595e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:03.610124 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7202c-e91f-460b-bb8f-8e9167596763 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:03.611671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7202c-e91f-460b-bb8f-8e9167596763 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:03.613620 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:03.657768 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9731f-25a9-4f62-99b0-b6d9c994595e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:03.659225 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9731f-25a9-4f62-99b0-b6d9c994595e None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:03.723232 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 259/516] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:50:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:50:03.724012 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7202c-e91f-460b-bb8f-8e9167596763 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:03.748187 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:03.778260 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 258/517] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:50:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:50:03.778260 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9731f-25a9-4f62-99b0-b6d9c994595e None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:03.850409 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7202c-e91f-460b-bb8f-8e9167596763 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:03.852882 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:03.895668 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee3b26-ff0d-4211-8719-d2f0cef0ddb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:03.896878 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee3b26-ff0d-4211-8719-d2f0cef0ddb1 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:03.897681 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee3b26-ff0d-4211-8719-d2f0cef0ddb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:03.897991 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dee3b26-ff0d-4211-8719-d2f0cef0ddb1 None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:03.898961 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee3b26-ff0d-4211-8719-d2f0cef0ddb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:03.899469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee3b26-ff0d-4211-8719-d2f0cef0ddb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:03.901583 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dee3b26-ff0d-4211-8719-d2f0cef0ddb1 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:03.903695 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9731f-25a9-4f62-99b0-b6d9c994595e None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:03.923352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 260/518] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:03.923352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee3b26-ff0d-4211-8719-d2f0cef0ddb1 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:03.950364 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b1063-764c-474d-804c-10070436b803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:03.951602 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b1063-764c-474d-804c-10070436b803 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:03.951884 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b1063-764c-474d-804c-10070436b803 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:03.952159 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087b1063-764c-474d-804c-10070436b803 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:03.964055 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b1063-764c-474d-804c-10070436b803 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:03.970399 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087b1063-764c-474d-804c-10070436b803 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:03.986643 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-087b1063-764c-474d-804c-10070436b803 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:03.986643 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:03.986643 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:03.986643 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:03.986643 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:03.986643 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:03.986643 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:03.986643 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:03.986643 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:03.986643 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:03.986643 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:03.986643 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:03.986643 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:03.986643 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:03.986643 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:03.987663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:03.987663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:03.987663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:03.987663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:03.987663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:03.987663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:03.987663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:03.987663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:03.987663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:03.987663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:03.987663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:03.987663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:03.987663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:03.987663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:03.987663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:03.987663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:03.987663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:03.988550 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:03.988550 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:03.988550 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:03.988550 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:03.988550 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 259/519] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:03.989020 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b1063-764c-474d-804c-10070436b803 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:04.025708 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:04.046975 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dee3b26-ff0d-4211-8719-d2f0cef0ddb1 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:04.081064 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9064e71-328a-4e83-b437-eb2ae2e1ec88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:04.081854 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9064e71-328a-4e83-b437-eb2ae2e1ec88 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:04.082135 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9064e71-328a-4e83-b437-eb2ae2e1ec88 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:04.082411 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9064e71-328a-4e83-b437-eb2ae2e1ec88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:04.094945 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9064e71-328a-4e83-b437-eb2ae2e1ec88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:04.096469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9064e71-328a-4e83-b437-eb2ae2e1ec88 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:04.106317 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087b1063-764c-474d-804c-10070436b803 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:04.113902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-d9064e71-328a-4e83-b437-eb2ae2e1ec88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:04.113902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:04.113902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:04.113902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:04.113902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:04.113902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:04.113902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:04.113902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:04.113902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:04.113902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:04.113902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:04.113902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:04.113902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:04.113902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:04.113902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:04.114944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:04.114944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:04.114944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:04.114944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:04.114944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:04.114944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:04.114944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:04.114944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:04.114944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:04.114944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:04.114944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:04.114944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:04.114944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:04.114944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:04.114944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:04.114944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:04.114944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:04.116014 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:04.116014 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:04.116014 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:04.116014 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:04.116014 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 261/520] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:04.116014 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9064e71-328a-4e83-b437-eb2ae2e1ec88 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:04.139666 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:04.152871 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d4560-97ea-4fe1-af3b-ca6d0ba0eb8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:04.154862 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d4560-97ea-4fe1-af3b-ca6d0ba0eb8b None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:04.154862 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d4560-97ea-4fe1-af3b-ca6d0ba0eb8b None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:04.154862 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962d4560-97ea-4fe1-af3b-ca6d0ba0eb8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:04.163106 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d4560-97ea-4fe1-af3b-ca6d0ba0eb8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:04.164558 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962d4560-97ea-4fe1-af3b-ca6d0ba0eb8b None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:04.179147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-962d4560-97ea-4fe1-af3b-ca6d0ba0eb8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:04.179147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:04.179147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:04.179147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:04.179147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:04.179147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:04.179147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:04.179147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:04.179147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:04.179147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:04.179147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:04.179147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:04.179147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:50:04.179147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:50:04.179147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:50:04.180072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:50:04.180072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:04.180072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:04.180072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:04.180072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:04.180072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:04.180072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:04.180072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:04.180072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:04.180072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:04.180072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:04.180072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:04.180072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:04.180072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:04.180072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:04.180072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:04.180072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:04.180975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:50:04.180975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:50:04.180975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:50:04.180975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:50:04.180975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:50:04.180975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:50:04.180975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:04.180975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:04.180975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 260/521] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:04.181431 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d4560-97ea-4fe1-af3b-ca6d0ba0eb8b None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:04.238312 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9064e71-328a-4e83-b437-eb2ae2e1ec88 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:04.274419 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:04.274592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d43f8-e14d-41ac-8fe2-2b5214293a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:04.275149 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d43f8-e14d-41ac-8fe2-2b5214293a3c None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:04.275429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d43f8-e14d-41ac-8fe2-2b5214293a3c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:04.275702 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5d43f8-e14d-41ac-8fe2-2b5214293a3c None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:04.276416 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d43f8-e14d-41ac-8fe2-2b5214293a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:04.276756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d43f8-e14d-41ac-8fe2-2b5214293a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:04.278135 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5d43f8-e14d-41ac-8fe2-2b5214293a3c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:04.287512 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962d4560-97ea-4fe1-af3b-ca6d0ba0eb8b None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:04.291020 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 262/522] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:04.291900 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d43f8-e14d-41ac-8fe2-2b5214293a3c None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:04.324884 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84935fa4-f531-447c-a683-7a368b8c86ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:04.325726 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84935fa4-f531-447c-a683-7a368b8c86ed None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:04.325992 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84935fa4-f531-447c-a683-7a368b8c86ed None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:04.326088 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84935fa4-f531-447c-a683-7a368b8c86ed None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:04.326767 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84935fa4-f531-447c-a683-7a368b8c86ed None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:04.327070 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84935fa4-f531-447c-a683-7a368b8c86ed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:04.328953 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84935fa4-f531-447c-a683-7a368b8c86ed None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:04.341061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 261/523] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:04.341700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84935fa4-f531-447c-a683-7a368b8c86ed None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:04.380687 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:04.407195 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5d43f8-e14d-41ac-8fe2-2b5214293a3c None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:04.445135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84935fa4-f531-447c-a683-7a368b8c86ed None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:04.455420 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f3292-9d19-4b59-9eae-c75559109c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:04.456368 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f3292-9d19-4b59-9eae-c75559109c9c None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:04.456703 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f3292-9d19-4b59-9eae-c75559109c9c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:04.457078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f3292-9d19-4b59-9eae-c75559109c9c None admin] PATH_INFO: `/v3/projects` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:04.457774 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f3292-9d19-4b59-9eae-c75559109c9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:04.458086 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f3292-9d19-4b59-9eae-c75559109c9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:04.459796 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f3292-9d19-4b59-9eae-c75559109c9c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:04.478796 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 263/524] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:50:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:04.479462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f3292-9d19-4b59-9eae-c75559109c9c None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:04.487775 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663111c6-a262-40ca-85df-007ea147a846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:04.488675 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663111c6-a262-40ca-85df-007ea147a846 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:04.488910 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663111c6-a262-40ca-85df-007ea147a846 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:04.489198 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663111c6-a262-40ca-85df-007ea147a846 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:04.496888 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663111c6-a262-40ca-85df-007ea147a846 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:04.498404 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663111c6-a262-40ca-85df-007ea147a846 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:04.512580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-663111c6-a262-40ca-85df-007ea147a846 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:04.512580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:04.512580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:04.512580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:04.512580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:04.512580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:04.512580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:04.512580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:04.512580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:04.512580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:04.512580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:04.512580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:04.512580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:50:04.512580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:50:04.512580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:50:04.513464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:50:04.513464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:04.513464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:04.513464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:04.513464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:04.513464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:04.513464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:04.513464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:04.513464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:04.513464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:04.513464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:04.513464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:04.513464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:04.513464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:04.513464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:04.513464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:04.513464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:04.514392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:50:04.514392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:50:04.514392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:50:04.514392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:50:04.514392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:50:04.514392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:50:04.514392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:04.514392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:04.514392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 262/525] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:04.515427 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663111c6-a262-40ca-85df-007ea147a846 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:04.527478 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:04.600799 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f3292-9d19-4b59-9eae-c75559109c9c None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:04.628907 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663111c6-a262-40ca-85df-007ea147a846 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:04.637745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ab1ef-45f6-436a-a8db-5391dabefaad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:04.638552 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ab1ef-45f6-436a-a8db-5391dabefaad None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:04.638831 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ab1ef-45f6-436a-a8db-5391dabefaad None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:04.639113 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9ab1ef-45f6-436a-a8db-5391dabefaad None admin] PATH_INFO: `/v3/projects/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:04.642315 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:04.648013 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ab1ef-45f6-436a-a8db-5391dabefaad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:04.649505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9ab1ef-45f6-436a-a8db-5391dabefaad None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:04.663579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-ab9ab1ef-45f6-436a-a8db-5391dabefaad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:04.663579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:04.663579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:04.663579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:04.663579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:04.663579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:04.663579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:04.663579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:04.663579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:04.663579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:04.663579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:04.663579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:04.663579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:50:04.663579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:50:04.663579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:50:04.664673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:50:04.664673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:04.664673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:04.664673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:04.664673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:04.664673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:04.664673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:04.664673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:04.664673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:04.664673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:04.664673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:04.664673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:04.664673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:04.664673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:04.664673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:04.664673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:04.664673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:04.665965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:50:04.665965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:50:04.665965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:50:04.665965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:50:04.665965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:50:04.665965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:50:04.665965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:04.665965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:04.668617 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d4717-562e-46d8-96a1-d5e405263b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:04.669569 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d4717-562e-46d8-96a1-d5e405263b26 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:04.669680 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 264/526] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:04.669967 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d4717-562e-46d8-96a1-d5e405263b26 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:04.670320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725d4717-562e-46d8-96a1-d5e405263b26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:04.670469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ab1ef-45f6-436a-a8db-5391dabefaad None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:04.671318 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d4717-562e-46d8-96a1-d5e405263b26 None admin] RBAC: Adding query filter params (role.id=f38b25010c404af5bbde51980f7e8dec, scope.project.id=2a58a74d443e40a782112277c58028b6, user.id=b8ba3c2afa1e4499bafda337dc4dc2a9) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:04.671685 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d4717-562e-46d8-96a1-d5e405263b26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:04.673240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725d4717-562e-46d8-96a1-d5e405263b26 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:04.689797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 263/527] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:50:04 2022] GET /identity/v3/role_assignments?user.id=b8ba3c2afa1e4499bafda337dc4dc2a9&scope.project.id=2a58a74d443e40a782112277c58028b6&role.id=f38b25010c404af5bbde51980f7e8dec => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:04.689797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d4717-562e-46d8-96a1-d5e405263b26 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:04.780407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:04.799641 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9ab1ef-45f6-436a-a8db-5391dabefaad None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:04.823515 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725d4717-562e-46d8-96a1-d5e405263b26 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:04.839894 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04b6d9-5242-4af4-885e-73728af05ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:04.840700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04b6d9-5242-4af4-885e-73728af05ff1 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:04.841063 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04b6d9-5242-4af4-885e-73728af05ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:04.841413 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f04b6d9-5242-4af4-885e-73728af05ff1 None admin] PATH_INFO: `/v3/projects` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:04.842291 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04b6d9-5242-4af4-885e-73728af05ff1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:04.842678 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04b6d9-5242-4af4-885e-73728af05ff1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:04.844282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f04b6d9-5242-4af4-885e-73728af05ff1 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:04.864030 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 265/528] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:50:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:04.870865 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04b6d9-5242-4af4-885e-73728af05ff1 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:04.881849 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f567c2f-2ace-4040-8b86-50977dd27c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:04.882635 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f567c2f-2ace-4040-8b86-50977dd27c80 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:04.882926 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f567c2f-2ace-4040-8b86-50977dd27c80 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:04.883201 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f567c2f-2ace-4040-8b86-50977dd27c80 None admin] PATH_INFO: `/v3/projects` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:04.884013 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f567c2f-2ace-4040-8b86-50977dd27c80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:04.884324 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f567c2f-2ace-4040-8b86-50977dd27c80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:04.885851 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f567c2f-2ace-4040-8b86-50977dd27c80 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:04.900038 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 264/529] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:50:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:04.905425 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f567c2f-2ace-4040-8b86-50977dd27c80 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:04.949671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:05.009278 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f04b6d9-5242-4af4-885e-73728af05ff1 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:05.020805 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f567c2f-2ace-4040-8b86-50977dd27c80 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:05.054608 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1bd902-8cfa-4ae4-bcd3-ad1adcaea217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:05.055326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bd902-8cfa-4ae4-bcd3-ad1adcaea217 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:05.055727 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bd902-8cfa-4ae4-bcd3-ad1adcaea217 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:05.056491 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1bd902-8cfa-4ae4-bcd3-ad1adcaea217 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:05.057759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bd902-8cfa-4ae4-bcd3-ad1adcaea217 None admin] RBAC: Adding query filter params (role.id=f38b25010c404af5bbde51980f7e8dec, scope.project.id=2a58a74d443e40a782112277c58028b6, user.id=efbe88187dd84518818114165f60a5ef) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:05.058157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bd902-8cfa-4ae4-bcd3-ad1adcaea217 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:05.059969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:05.061272 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1bd902-8cfa-4ae4-bcd3-ad1adcaea217 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:05.067004 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83d5248-eac3-4b8e-b753-4eaf51846550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:05.067908 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d5248-eac3-4b8e-b753-4eaf51846550 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:05.068339 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d5248-eac3-4b8e-b753-4eaf51846550 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:05.068784 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83d5248-eac3-4b8e-b753-4eaf51846550 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:05.069930 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d5248-eac3-4b8e-b753-4eaf51846550 None admin] RBAC: Adding query filter params (role.id=f38b25010c404af5bbde51980f7e8dec, scope.project.id=2a58a74d443e40a782112277c58028b6, user.id=513bc0a2d10240a5bc12cb402da41faf) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:05.070387 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d5248-eac3-4b8e-b753-4eaf51846550 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:05.072002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83d5248-eac3-4b8e-b753-4eaf51846550 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:05.075014 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 266/530] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:50:04 2022] GET /identity/v3/role_assignments?user.id=efbe88187dd84518818114165f60a5ef&scope.project.id=2a58a74d443e40a782112277c58028b6&role.id=f38b25010c404af5bbde51980f7e8dec => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:05.080039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 265/531] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:50:04 2022] GET /identity/v3/role_assignments?user.id=513bc0a2d10240a5bc12cb402da41faf&scope.project.id=2a58a74d443e40a782112277c58028b6&role.id=f38b25010c404af5bbde51980f7e8dec => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:05.724990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3e803-d45a-4b52-b908-673a67d5baaf None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:05.725279 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3e803-d45a-4b52-b908-673a67d5baaf None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:05.725558 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c3e803-d45a-4b52-b908-673a67d5baaf None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:05.726915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 267/532] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:05.732594 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b9f76-7b7c-4280-8c98-3048c17b47d6 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:05.732913 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b9f76-7b7c-4280-8c98-3048c17b47d6 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:05.733193 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b9f76-7b7c-4280-8c98-3048c17b47d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:05.755716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-7a4b9f76-7b7c-4280-8c98-3048c17b47d6 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:05.756942 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-7a4b9f76-7b7c-4280-8c98-3048c17b47d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:05.828340 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 266/533] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:50:05.851673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3e803-d45a-4b52-b908-673a67d5baaf None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:05.966188 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c3e803-d45a-4b52-b908-673a67d5baaf None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:05.985215 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:06.003293 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adb36a-9be8-43dc-ba66-e49fcce07981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:06.004354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adb36a-9be8-43dc-ba66-e49fcce07981 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:06.016178 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adb36a-9be8-43dc-ba66-e49fcce07981 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:06.016178 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01adb36a-9be8-43dc-ba66-e49fcce07981 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:06.016178 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01adb36a-9be8-43dc-ba66-e49fcce07981 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:50:06.023737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-01adb36a-9be8-43dc-ba66-e49fcce07981 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:06.023737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:06.023737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:06.023737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:06.023737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:06.023737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:06.023737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:06.023737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:06.023737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:06.023737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:06.023737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:06.023737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:06.023737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:50:06.023737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:50:06.023737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:50:06.023737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:50:06.024622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:50:06.024622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:50:06.024622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:50:06.024622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:50:06.024622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:06.024622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:06.024622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:06.024622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:06.024622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:06.024622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:06.024622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:06.024622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:06.024622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:06.024622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:06.024622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:06.024622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:06.025468 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:06.025468 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:06.025468 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:06.025468 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:06.025468 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:50:06.025468 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:50:06.025468 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:50:06.025468 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:50:06.025468 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:50:06.025468 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:50:06.025468 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:06.025468 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:06.028161 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 268/534] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 12:50:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:06.034361 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b9f76-7b7c-4280-8c98-3048c17b47d6 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:06.150240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b9f76-7b7c-4280-8c98-3048c17b47d6 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:06.189173 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c42cb7-f7fb-4f2b-bbbe-edd54b1b73e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:06.190203 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c42cb7-f7fb-4f2b-bbbe-edd54b1b73e4 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:06.190678 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c42cb7-f7fb-4f2b-bbbe-edd54b1b73e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:06.191174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c42cb7-f7fb-4f2b-bbbe-edd54b1b73e4 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:06.192121 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c42cb7-f7fb-4f2b-bbbe-edd54b1b73e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:06.192627 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c42cb7-f7fb-4f2b-bbbe-edd54b1b73e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:06.194318 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c42cb7-f7fb-4f2b-bbbe-edd54b1b73e4 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:06.196849 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:06.205310 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 267/535] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 12:50:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:06.210929 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adb36a-9be8-43dc-ba66-e49fcce07981 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:06.323165 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01adb36a-9be8-43dc-ba66-e49fcce07981 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:06.359184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c605ec-b3a1-4203-9f73-c122479dda12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:06.360043 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c605ec-b3a1-4203-9f73-c122479dda12 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:06.360333 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c605ec-b3a1-4203-9f73-c122479dda12 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:06.360609 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c605ec-b3a1-4203-9f73-c122479dda12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:06.371677 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c605ec-b3a1-4203-9f73-c122479dda12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:06.373184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c605ec-b3a1-4203-9f73-c122479dda12 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:06.391329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-10c605ec-b3a1-4203-9f73-c122479dda12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:06.391329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:06.391329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:06.391329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:06.391329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:06.391329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:06.391329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:06.391329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:06.391329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:06.391329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:06.391329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:06.391329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:06.391329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:06.391329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:06.391329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:06.392274 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:06.392274 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:06.392274 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:06.392274 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:06.392274 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:06.392274 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:06.392274 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:06.392274 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:06.392274 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:06.392274 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:06.392274 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:06.392274 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:06.392274 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:06.392274 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:06.392274 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:06.392274 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:06.392274 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:06.393151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:06.393151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:06.393151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:06.393151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:06.393151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 269/536] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:06.398276 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c42cb7-f7fb-4f2b-bbbe-edd54b1b73e4 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:06.506833 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c42cb7-f7fb-4f2b-bbbe-edd54b1b73e4 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:06.542380 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3beda1-e9f3-4ef5-a01f-2c8e45b9d60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:06.543475 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3beda1-e9f3-4ef5-a01f-2c8e45b9d60f None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:06.543961 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3beda1-e9f3-4ef5-a01f-2c8e45b9d60f None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:06.544421 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3beda1-e9f3-4ef5-a01f-2c8e45b9d60f None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:06.545319 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3beda1-e9f3-4ef5-a01f-2c8e45b9d60f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:06.545784 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3beda1-e9f3-4ef5-a01f-2c8e45b9d60f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:06.552690 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3beda1-e9f3-4ef5-a01f-2c8e45b9d60f None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:06.560344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 268/537] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:06.565679 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c605ec-b3a1-4203-9f73-c122479dda12 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:06.599088 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:06.676866 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c605ec-b3a1-4203-9f73-c122479dda12 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:06.713647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b8b7f-f399-49ac-89e4-54248e7ef129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:06.714441 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b8b7f-f399-49ac-89e4-54248e7ef129 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:06.714726 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b8b7f-f399-49ac-89e4-54248e7ef129 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:06.715001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b8b7f-f399-49ac-89e4-54248e7ef129 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:06.723260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b8b7f-f399-49ac-89e4-54248e7ef129 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:06.724759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0b8b7f-f399-49ac-89e4-54248e7ef129 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:06.739840 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-6b0b8b7f-f399-49ac-89e4-54248e7ef129 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 12:50:06.739840 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:06.739840 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:06.739840 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:06.739840 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:06.739840 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:06.739840 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:06.739840 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:06.739840 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:06.739840 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:06.739840 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:06.739840 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:06.739840 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:50:06.739840 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:50:06.739840 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:50:06.739840 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:50:06.740953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:06.740953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:06.740953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:50:06.740953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:06.740953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:50:06.740953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:06.740953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:06.740953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:06.740953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:06.740953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:06.740953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:06.740953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:06.740953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:06.740953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:06.740953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:06.740953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:06.740953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:06.740953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:06.741913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:06.741913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:06.741913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:50:06.741913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:50:06.741913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:50:06.741913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:50:06.741913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:50:06.741913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:50:06.741913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 12:50:06.741913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:06.741913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 270/538] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 14 12:50:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:06.748365 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3beda1-e9f3-4ef5-a01f-2c8e45b9d60f None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:06.802747 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:06.856269 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3beda1-e9f3-4ef5-a01f-2c8e45b9d60f None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:06.913547 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ebeb2c-0bfa-4b18-adb0-7232988c0803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:06.914239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebeb2c-0bfa-4b18-adb0-7232988c0803 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:06.914525 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebeb2c-0bfa-4b18-adb0-7232988c0803 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:06.914800 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ebeb2c-0bfa-4b18-adb0-7232988c0803 None admin] PATH_INFO: `/v3/users` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:06.915662 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ebeb2c-0bfa-4b18-adb0-7232988c0803 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:06.915977 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ebeb2c-0bfa-4b18-adb0-7232988c0803 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:06.917523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ebeb2c-0bfa-4b18-adb0-7232988c0803 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:06.938517 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 269/539] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 14 12:50:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:06.943967 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b8b7f-f399-49ac-89e4-54248e7ef129 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:07.042558 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:07.053848 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b8b7f-f399-49ac-89e4-54248e7ef129 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:07.062352 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e4c9f-90cc-4634-bbe9-b69d60b28fdf None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:07.062927 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e4c9f-90cc-4634-bbe9-b69d60b28fdf None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:07.062927 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e4c9f-90cc-4634-bbe9-b69d60b28fdf None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:07.064448 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 270/540] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:50:07.069763 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006f846-578a-480c-8ce9-45ef29d7b90a None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:07.076603 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006f846-578a-480c-8ce9-45ef29d7b90a None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:07.076603 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a006f846-578a-480c-8ce9-45ef29d7b90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:07.089005 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-a006f846-578a-480c-8ce9-45ef29d7b90a None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:07.090329 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-a006f846-578a-480c-8ce9-45ef29d7b90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:07.100719 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fc85c-24b0-49b7-ae34-22c483457396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:07.102228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fc85c-24b0-49b7-ae34-22c483457396 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:07.102738 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fc85c-24b0-49b7-ae34-22c483457396 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:07.103219 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fc85c-24b0-49b7-ae34-22c483457396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:07.120442 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fc85c-24b0-49b7-ae34-22c483457396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:07.122700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03fc85c-24b0-49b7-ae34-22c483457396 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:07.142730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-b03fc85c-24b0-49b7-ae34-22c483457396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:07.142730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:07.142730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:07.142730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:07.142730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:07.142730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:07.142730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:07.142730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:07.142730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:07.142730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:07.142730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:07.142730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:07.142730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:07.142730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:07.142730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:07.143669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:07.143669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:07.143669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:07.143669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:07.143669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:07.143669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:07.143669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:07.143669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:07.143669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:07.143669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:07.143669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:07.143669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:07.143669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:07.143669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:07.143669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:07.143669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:07.143669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:07.144510 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:07.144510 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:07.144510 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:07.144510 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:07.144510 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 271/541] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:07.150694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fc85c-24b0-49b7-ae34-22c483457396 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:07.180416 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 271/542] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:50:07.203978 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006f846-578a-480c-8ce9-45ef29d7b90a None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:07.240679 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:07.276137 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fc85c-24b0-49b7-ae34-22c483457396 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:07.317848 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a006f846-578a-480c-8ce9-45ef29d7b90a None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:07.323019 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e30451-7ee7-46f9-a006-5c6dd24e6dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:07.323863 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e30451-7ee7-46f9-a006-5c6dd24e6dcc None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:07.324248 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e30451-7ee7-46f9-a006-5c6dd24e6dcc None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:07.324624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e30451-7ee7-46f9-a006-5c6dd24e6dcc None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:07.325523 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e30451-7ee7-46f9-a006-5c6dd24e6dcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:07.325947 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e30451-7ee7-46f9-a006-5c6dd24e6dcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:07.327547 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e30451-7ee7-46f9-a006-5c6dd24e6dcc None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:07.344978 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 272/543] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:50:07.350338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e30451-7ee7-46f9-a006-5c6dd24e6dcc None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:07.353413 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:07.368542 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93402a56-7c57-4123-825b-3132a98031fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:07.369527 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93402a56-7c57-4123-825b-3132a98031fc None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:07.369960 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93402a56-7c57-4123-825b-3132a98031fc None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:07.370332 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93402a56-7c57-4123-825b-3132a98031fc None admin] PATH_INFO: `/v3/roles/service` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:07.383022 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93402a56-7c57-4123-825b-3132a98031fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:50:07.391523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-93402a56-7c57-4123-825b-3132a98031fc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:07.391523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:07.391523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:07.391523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:07.391523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:07.391523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:07.391523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:07.391523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:07.391523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:07.391523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:07.391523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:07.391523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:07.391523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:50:07.391523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:50:07.391523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:50:07.391523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:50:07.392653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:50:07.392653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:50:07.392653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:50:07.392653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:50:07.392653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:07.392653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:07.392653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:07.392653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:07.392653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:07.392653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:07.392653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:07.392653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:07.392653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:07.392653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:07.392653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:07.392653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:07.393640 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:07.393640 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:07.393640 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:07.393640 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:07.393640 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:50:07.393640 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:50:07.393640 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:50:07.393640 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:50:07.393640 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:50:07.393640 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:50:07.393640 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:07.393640 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:07.401450 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 272/544] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 12:50:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:07.402688 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93402a56-7c57-4123-825b-3132a98031fc None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:07.488342 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e30451-7ee7-46f9-a006-5c6dd24e6dcc None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:07.510166 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:07.515976 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93402a56-7c57-4123-825b-3132a98031fc None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:07.523786 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e2bff7-3422-4a5c-9429-df6e7b7299dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:07.524582 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2bff7-3422-4a5c-9429-df6e7b7299dc None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:07.524895 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2bff7-3422-4a5c-9429-df6e7b7299dc None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:07.525171 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2bff7-3422-4a5c-9429-df6e7b7299dc None admin] PATH_INFO: `/v3/projects/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:07.532468 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2bff7-3422-4a5c-9429-df6e7b7299dc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:07.533969 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e2bff7-3422-4a5c-9429-df6e7b7299dc None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:07.548068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-39e2bff7-3422-4a5c-9429-df6e7b7299dc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:07.548068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:07.548068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:07.548068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:07.548068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:07.548068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:07.548068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:07.548068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:07.548068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:07.548068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:07.548068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:07.548068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:07.548068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:50:07.548068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:50:07.548068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:50:07.549053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:50:07.549053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:07.549053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:07.549053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:07.549053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:07.549053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:07.549053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:07.549053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:07.549053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:07.549053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:07.549053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:07.549053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:07.549053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:07.549053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:07.549053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:07.549053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:07.549053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:07.549905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:50:07.549905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:50:07.549905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:50:07.549905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:50:07.549905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:50:07.549905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:50:07.549905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:07.549905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:07.549905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 273/545] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:07.550645 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfac630-943a-449f-9a71-b375fd410ba7 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:07.550895 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfac630-943a-449f-9a71-b375fd410ba7 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:07.551166 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfac630-943a-449f-9a71-b375fd410ba7 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:07.552417 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 274/546] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:07.553500 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814eb1e-c039-41a5-bd4c-b6d665f3781b None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:07.553910 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814eb1e-c039-41a5-bd4c-b6d665f3781b None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:07.554195 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814eb1e-c039-41a5-bd4c-b6d665f3781b None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:07.554441 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cd82d5-cd82-47cf-bcf1-e0735c3a86aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:07.555130 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd82d5-cd82-47cf-bcf1-e0735c3a86aa None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:07.557078 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd82d5-cd82-47cf-bcf1-e0735c3a86aa None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:07.557211 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 275/547] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:07.557290 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cd82d5-cd82-47cf-bcf1-e0735c3a86aa None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:07.557368 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814eb1e-c039-41a5-bd4c-b6d665f3781b None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:07.557438 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd82d5-cd82-47cf-bcf1-e0735c3a86aa None admin] RBAC: Adding query filter params (name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:07.557438 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd82d5-cd82-47cf-bcf1-e0735c3a86aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:07.558104 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cd82d5-cd82-47cf-bcf1-e0735c3a86aa None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:07.567002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 273/548] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 12:50:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:50:07.568254 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab72f63-1726-4d4c-8922-65f9819a5f76 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:07.568551 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab72f63-1726-4d4c-8922-65f9819a5f76 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:07.568861 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab72f63-1726-4d4c-8922-65f9819a5f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:07.586398 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-aab72f63-1726-4d4c-8922-65f9819a5f76 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:07.587578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-aab72f63-1726-4d4c-8922-65f9819a5f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:07.621769 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:07.659417 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 274/549] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:50:07.660874 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09248ac1-62dd-4727-b774-fc0accb88a8f None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:07.661214 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09248ac1-62dd-4727-b774-fc0accb88a8f None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:07.661508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09248ac1-62dd-4727-b774-fc0accb88a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:07.670101 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a814eb1e-c039-41a5-bd4c-b6d665f3781b None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:07.686007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-09248ac1-62dd-4727-b774-fc0accb88a8f None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:07.687740 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-09248ac1-62dd-4727-b774-fc0accb88a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:07.705606 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c50ac-70b4-469a-888f-ad6852d882b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:07.706266 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c50ac-70b4-469a-888f-ad6852d882b4 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:07.706550 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c50ac-70b4-469a-888f-ad6852d882b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:07.706830 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c50ac-70b4-469a-888f-ad6852d882b4 None admin] PATH_INFO: `/v3/projects` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:07.707620 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c50ac-70b4-469a-888f-ad6852d882b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:07.707934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c50ac-70b4-469a-888f-ad6852d882b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:07.709686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1c50ac-70b4-469a-888f-ad6852d882b4 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:07.721944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 276/550] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:50:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:07.722749 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c50ac-70b4-469a-888f-ad6852d882b4 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:07.756566 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 275/551] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:50:07.757425 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09248ac1-62dd-4727-b774-fc0accb88a8f None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:07.775390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:07.833676 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c50ac-70b4-469a-888f-ad6852d882b4 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:07.855755 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09248ac1-62dd-4727-b774-fc0accb88a8f None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:07.856249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:07.868313 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619187f1-aeb8-4746-b1b8-dcb966174613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:07.869149 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619187f1-aeb8-4746-b1b8-dcb966174613 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:07.869682 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619187f1-aeb8-4746-b1b8-dcb966174613 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:07.869682 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619187f1-aeb8-4746-b1b8-dcb966174613 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:07.880731 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619187f1-aeb8-4746-b1b8-dcb966174613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:07.882183 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619187f1-aeb8-4746-b1b8-dcb966174613 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:07.890078 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb2a2b-3e62-4f7e-ae1f-6d64f8e421d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:07.891185 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb2a2b-3e62-4f7e-ae1f-6d64f8e421d4 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:07.891185 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb2a2b-3e62-4f7e-ae1f-6d64f8e421d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:07.891391 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb2a2b-3e62-4f7e-ae1f-6d64f8e421d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:07.900474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-619187f1-aeb8-4746-b1b8-dcb966174613 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:07.900474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:07.900474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:07.900474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:07.900474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:07.900474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:07.900474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:07.900474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:07.900474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:07.900474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:07.900474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:07.900474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:07.900474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:07.900474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:07.900474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:07.901728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:07.901728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:07.901728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:07.901728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:07.901728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:07.901728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:07.901728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:07.901728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:07.901728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:07.901728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:07.901728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:07.901728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:07.901728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:07.901728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:07.901728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:07.901728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:07.901728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:07.902941 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:07.902941 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:07.902941 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:07.902941 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:07.902941 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 277/552] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:07.902941 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619187f1-aeb8-4746-b1b8-dcb966174613 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:07.904011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb2a2b-3e62-4f7e-ae1f-6d64f8e421d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:50:07.912167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-9ebb2a2b-3e62-4f7e-ae1f-6d64f8e421d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:07.912167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:07.912167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:07.912167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:07.912167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:07.912167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:07.912167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:07.912167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:07.912167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:07.912167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:07.912167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:07.912167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:07.912167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:50:07.912167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:50:07.912167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:50:07.912167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:50:07.913113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:50:07.913113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:50:07.913113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:50:07.913113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:50:07.913113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:07.913113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:07.913113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:07.913113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:07.913113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:07.913113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:07.913113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:07.913113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:07.913113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:07.913113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:07.913113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:07.913113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:07.914099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:07.914099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:07.914099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:07.914099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:07.914099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:50:07.914099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:50:07.914099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:50:07.914099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:50:07.914099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:50:07.914099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:50:07.914099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:07.914099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:07.914099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 276/553] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 12:50:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:07.914099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb2a2b-3e62-4f7e-ae1f-6d64f8e421d4 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:07.990767 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:08.006373 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619187f1-aeb8-4746-b1b8-dcb966174613 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:08.011564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb2a2b-3e62-4f7e-ae1f-6d64f8e421d4 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:08.040834 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f6d51-1a49-4902-abce-ab57691a5acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:08.041717 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f6d51-1a49-4902-abce-ab57691a5acc None admin] REQUEST_METHOD: `PUT` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:08.042006 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f6d51-1a49-4902-abce-ab57691a5acc None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:08.042277 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043f6d51-1a49-4902-abce-ab57691a5acc None admin] PATH_INFO: `/v3/projects/2a58a74d443e40a782112277c58028b6/users/1faa19de04744a4084a9c60c4af64f3e/roles/f38b25010c404af5bbde51980f7e8dec` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:08.046431 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82270145-eb11-44ff-a7a5-26a34c07e023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:08.047215 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82270145-eb11-44ff-a7a5-26a34c07e023 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:08.047499 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82270145-eb11-44ff-a7a5-26a34c07e023 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:08.047776 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82270145-eb11-44ff-a7a5-26a34c07e023 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:08.058671 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82270145-eb11-44ff-a7a5-26a34c07e023 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:50:08.058839 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f6d51-1a49-4902-abce-ab57691a5acc None admin] RBAC: Authorizing `identity:create_grant(project_id=2a58a74d443e40a782112277c58028b6, user_id=1faa19de04744a4084a9c60c4af64f3e, role_id=f38b25010c404af5bbde51980f7e8dec)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:08.060136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043f6d51-1a49-4902-abce-ab57691a5acc None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:08.066481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-82270145-eb11-44ff-a7a5-26a34c07e023 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:08.066481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:08.066481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:08.066481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:08.066481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:08.066481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:08.066481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:08.066481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:08.066481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:08.066481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:08.066481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:08.066481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:08.066481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:50:08.066481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:50:08.066481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:50:08.066481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:50:08.067915 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:50:08.067915 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:50:08.067915 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:50:08.067915 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:50:08.067915 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:08.067915 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:08.067915 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:08.067915 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:08.067915 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:08.067915 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:08.067915 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:08.067915 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:08.067915 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:08.067915 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:08.067915 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:08.067915 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:08.069039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:08.069039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:08.069039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:08.069039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:08.069039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:50:08.069039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:50:08.069039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:50:08.069039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:50:08.069039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:50:08.069039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:50:08.069039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:08.069039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:08.069039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 277/554] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 12:50:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:08.069039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82270145-eb11-44ff-a7a5-26a34c07e023 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:08.146993 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 278/555] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 12:50:07 2022] PUT /identity/v3/projects/2a58a74d443e40a782112277c58028b6/users/1faa19de04744a4084a9c60c4af64f3e/roles/f38b25010c404af5bbde51980f7e8dec => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:50:08.148655 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f6d51-1a49-4902-abce-ab57691a5acc None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:08.174834 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82270145-eb11-44ff-a7a5-26a34c07e023 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:08.181576 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:08.215760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a0f45-ad6f-40e6-82f3-f6240fa97da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:08.216429 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a0f45-ad6f-40e6-82f3-f6240fa97da3 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:08.216740 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a0f45-ad6f-40e6-82f3-f6240fa97da3 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:08.217034 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a0f45-ad6f-40e6-82f3-f6240fa97da3 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:08.218008 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a0f45-ad6f-40e6-82f3-f6240fa97da3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:08.218142 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a0f45-ad6f-40e6-82f3-f6240fa97da3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:08.219525 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a0f45-ad6f-40e6-82f3-f6240fa97da3 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:08.228042 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:08.238719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 278/556] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:08.238719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a0f45-ad6f-40e6-82f3-f6240fa97da3 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:08.274779 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043f6d51-1a49-4902-abce-ab57691a5acc None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:08.311101 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca01f4-54b7-493d-98d2-b1050b9976df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:08.312380 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca01f4-54b7-493d-98d2-b1050b9976df None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:08.312695 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca01f4-54b7-493d-98d2-b1050b9976df None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:08.313068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ca01f4-54b7-493d-98d2-b1050b9976df None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:08.313814 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca01f4-54b7-493d-98d2-b1050b9976df None admin] RBAC: Adding query filter params (name=service) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:08.314130 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca01f4-54b7-493d-98d2-b1050b9976df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:08.315575 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ca01f4-54b7-493d-98d2-b1050b9976df None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:08.325441 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 279/557] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 12:50:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:08.326122 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca01f4-54b7-493d-98d2-b1050b9976df None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:08.362060 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a0f45-ad6f-40e6-82f3-f6240fa97da3 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:08.400052 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de65e2-b977-4acb-96eb-e412fc6511ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:08.400981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de65e2-b977-4acb-96eb-e412fc6511ea None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:08.401147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de65e2-b977-4acb-96eb-e412fc6511ea None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:08.401313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de65e2-b977-4acb-96eb-e412fc6511ea None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:08.402046 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de65e2-b977-4acb-96eb-e412fc6511ea None admin] RBAC: Adding query filter params (name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:08.404682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de65e2-b977-4acb-96eb-e412fc6511ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:08.404682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de65e2-b977-4acb-96eb-e412fc6511ea None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:08.415039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 279/558] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 12:50:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:08.415039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de65e2-b977-4acb-96eb-e412fc6511ea None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:08.428430 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:08.444314 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ca01f4-54b7-493d-98d2-b1050b9976df None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:08.486331 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:08.487196 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828e513-6be8-4a82-9501-0d7095a89d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:08.487996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828e513-6be8-4a82-9501-0d7095a89d20 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:08.488281 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828e513-6be8-4a82-9501-0d7095a89d20 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:08.488552 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9828e513-6be8-4a82-9501-0d7095a89d20 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:08.496926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828e513-6be8-4a82-9501-0d7095a89d20 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:08.498837 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9828e513-6be8-4a82-9501-0d7095a89d20 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:08.513522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-9828e513-6be8-4a82-9501-0d7095a89d20 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 12:50:08.513522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:08.513522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:08.513522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:08.513522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:08.513522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:08.513522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:08.513522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:08.513522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:08.513522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:08.513522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:08.513522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:08.513522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:50:08.513522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:50:08.513522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:50:08.513522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:50:08.514709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:08.514709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:08.514709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:50:08.514709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:08.514709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:50:08.514709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:08.514709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:08.514709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:08.514709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:08.514709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:08.514709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:08.514709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:08.514709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:08.514709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:08.514709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:08.514709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:08.514709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:08.514709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:08.515924 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:08.515924 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:08.515924 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:50:08.515924 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:50:08.515924 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:50:08.515924 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:50:08.515924 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:50:08.515924 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:50:08.515924 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 12:50:08.515924 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:08.519408 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 280/559] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:50:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:08.520288 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828e513-6be8-4a82-9501-0d7095a89d20 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:08.534702 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de65e2-b977-4acb-96eb-e412fc6511ea None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:08.570300 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47466e6-6d9e-4f05-9961-83de0e32ad13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:08.571100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47466e6-6d9e-4f05-9961-83de0e32ad13 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:08.571384 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47466e6-6d9e-4f05-9961-83de0e32ad13 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:08.571663 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47466e6-6d9e-4f05-9961-83de0e32ad13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:08.583904 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47466e6-6d9e-4f05-9961-83de0e32ad13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:08.585650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47466e6-6d9e-4f05-9961-83de0e32ad13 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:08.603230 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-f47466e6-6d9e-4f05-9961-83de0e32ad13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:08.603230 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:08.603230 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:08.603230 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:08.603230 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:08.603230 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:08.603230 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:08.603230 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:08.603230 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:08.603230 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:08.603230 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:08.603230 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:08.603230 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:08.603230 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:08.603230 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:08.604355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:08.604355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:08.604355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:08.604355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:08.604355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:08.604355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:08.604355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:08.604355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:08.604355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:08.604355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:08.604355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:08.604355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:08.604355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:08.604355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:08.604355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:08.604355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:08.604355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:08.605483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:08.605483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:08.605483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:08.605483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:08.609055 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 280/560] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:08.609940 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47466e6-6d9e-4f05-9961-83de0e32ad13 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:08.634423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9828e513-6be8-4a82-9501-0d7095a89d20 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:08.673832 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512624a3-d5af-4345-8173-e7daa5642a05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:08.674965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512624a3-d5af-4345-8173-e7daa5642a05 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:08.675442 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512624a3-d5af-4345-8173-e7daa5642a05 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:08.675786 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512624a3-d5af-4345-8173-e7daa5642a05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:08.687821 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512624a3-d5af-4345-8173-e7daa5642a05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:08.689340 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512624a3-d5af-4345-8173-e7daa5642a05 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:08.696803 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:08.709283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-512624a3-d5af-4345-8173-e7daa5642a05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:08.709283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:08.709283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:08.709283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:08.709283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:08.709283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:08.709283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:08.709283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:08.709283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:08.709283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:08.709283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:08.709283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:08.709283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:08.709283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:08.709283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:08.710445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:08.710445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:08.710445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:08.710445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:08.710445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:08.710445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:08.710445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:08.710445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:08.710445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:08.710445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:08.710445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:08.710445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:08.710445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:08.710445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:08.710445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:08.710445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:08.710445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:08.711479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:08.711479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:08.711479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:08.711479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:08.711479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 281/561] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:08.712042 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512624a3-d5af-4345-8173-e7daa5642a05 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:08.726136 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47466e6-6d9e-4f05-9961-83de0e32ad13 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:08.739879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:08.761353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a2c7e-0dd2-4129-9624-ddbec0c3c371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:08.762140 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a2c7e-0dd2-4129-9624-ddbec0c3c371 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:08.762428 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a2c7e-0dd2-4129-9624-ddbec0c3c371 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:08.762737 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a2c7e-0dd2-4129-9624-ddbec0c3c371 None admin] PATH_INFO: `/v3/users` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:08.763570 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a2c7e-0dd2-4129-9624-ddbec0c3c371 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:08.763879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a2c7e-0dd2-4129-9624-ddbec0c3c371 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:08.765906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a2c7e-0dd2-4129-9624-ddbec0c3c371 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:08.784680 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 281/562] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jul 14 12:50:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:08.785461 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a2c7e-0dd2-4129-9624-ddbec0c3c371 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:08.832250 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512624a3-d5af-4345-8173-e7daa5642a05 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:08.867025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a29992-8a9d-4374-a41d-c529e77461c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:08.867954 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a29992-8a9d-4374-a41d-c529e77461c6 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:08.868520 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a29992-8a9d-4374-a41d-c529e77461c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:08.868768 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a29992-8a9d-4374-a41d-c529e77461c6 None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:08.869436 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a29992-8a9d-4374-a41d-c529e77461c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:08.869745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a29992-8a9d-4374-a41d-c529e77461c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:08.871119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a29992-8a9d-4374-a41d-c529e77461c6 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:08.883826 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 282/563] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:08.886326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a29992-8a9d-4374-a41d-c529e77461c6 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:08.894972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a2c7e-0dd2-4129-9624-ddbec0c3c371 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:08.941926 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a755f-84cd-4c99-ac57-57a9eeb29a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:08.942824 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a755f-84cd-4c99-ac57-57a9eeb29a3c None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:08.943371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a755f-84cd-4c99-ac57-57a9eeb29a3c None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:08.943967 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0a755f-84cd-4c99-ac57-57a9eeb29a3c None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:08.945558 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a755f-84cd-4c99-ac57-57a9eeb29a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:08.946303 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a755f-84cd-4c99-ac57-57a9eeb29a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:08.949420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0a755f-84cd-4c99-ac57-57a9eeb29a3c None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:08.950099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:08.971206 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 282/564] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:08.971893 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a755f-84cd-4c99-ac57-57a9eeb29a3c None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:08.994438 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a29992-8a9d-4374-a41d-c529e77461c6 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:09.009325 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:09.028991 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066173b2-5efb-4965-8378-fd463c08001c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:09.030027 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066173b2-5efb-4965-8378-fd463c08001c None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:09.030312 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066173b2-5efb-4965-8378-fd463c08001c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:09.031271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066173b2-5efb-4965-8378-fd463c08001c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:09.042524 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066173b2-5efb-4965-8378-fd463c08001c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:09.043980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066173b2-5efb-4965-8378-fd463c08001c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:09.062604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-066173b2-5efb-4965-8378-fd463c08001c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:09.062604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:09.062604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:09.062604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:09.062604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:09.062604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:09.062604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:09.062604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:09.062604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:09.062604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:09.062604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:09.062604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:09.062604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:09.062604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:09.062604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:09.063527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:09.063527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:09.063527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:09.063527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:09.063527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:09.063527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:09.063527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:09.063527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:09.063527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:09.063527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:09.063527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:09.063527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:09.063527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:09.063527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:09.063527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:09.063527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:09.063527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:09.064423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:09.064423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:09.064423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:09.064423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:09.064423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 283/565] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:09.064735 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066173b2-5efb-4965-8378-fd463c08001c None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:09.093841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0a755f-84cd-4c99-ac57-57a9eeb29a3c None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:09.129290 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe781329-9535-4236-88c0-aacc1d93db72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:09.130093 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe781329-9535-4236-88c0-aacc1d93db72 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:09.130370 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe781329-9535-4236-88c0-aacc1d93db72 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:09.130649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe781329-9535-4236-88c0-aacc1d93db72 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:09.139589 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe781329-9535-4236-88c0-aacc1d93db72 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:09.141255 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe781329-9535-4236-88c0-aacc1d93db72 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:09.156064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-fe781329-9535-4236-88c0-aacc1d93db72 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 12:50:09.156064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:09.156064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:09.156064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:09.156064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:09.156064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:09.156064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:09.156064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:09.156064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:09.156064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:09.156064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:09.156064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:09.156064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:50:09.156064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:50:09.156064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:50:09.156064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:50:09.157240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:09.157240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:09.157240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:50:09.157240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:09.157240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:50:09.157240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:09.157240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:09.157240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:09.157240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:09.157240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:09.157240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:09.157240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:09.157240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:09.157240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:09.157240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:09.157240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:09.157240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:09.157240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:09.158338 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:09.158338 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:09.158338 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:50:09.158338 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:50:09.158338 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:50:09.158338 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:50:09.158338 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:50:09.158338 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:50:09.158338 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 12:50:09.158338 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:09.160792 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 283/566] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:50:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:09.161969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe781329-9535-4236-88c0-aacc1d93db72 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:09.182913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066173b2-5efb-4965-8378-fd463c08001c None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:09.196459 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:09.230848 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140bc79-2351-48ac-a074-9f9d20049c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:09.231653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140bc79-2351-48ac-a074-9f9d20049c2b None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:09.231941 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140bc79-2351-48ac-a074-9f9d20049c2b None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:09.232331 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0140bc79-2351-48ac-a074-9f9d20049c2b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:09.240559 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140bc79-2351-48ac-a074-9f9d20049c2b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:09.242065 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0140bc79-2351-48ac-a074-9f9d20049c2b None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:09.256535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-0140bc79-2351-48ac-a074-9f9d20049c2b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 12:50:09.256535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:09.256535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:09.256535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:09.256535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:09.256535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:09.256535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:09.256535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:09.256535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:09.256535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:09.256535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:09.256535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:09.256535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:50:09.256535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:50:09.256535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:50:09.256535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:50:09.257729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:09.257729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:09.257729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:50:09.257729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:09.257729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:50:09.257729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:09.257729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:09.257729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:09.257729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:09.257729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:09.257729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:09.257729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:09.257729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:09.257729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:09.257729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:09.257729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:09.257729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:09.257729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:09.258886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:09.258886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:09.258886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:50:09.258886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:50:09.258886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:50:09.258886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:50:09.258886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:50:09.258886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:50:09.258886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 12:50:09.258886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:09.262257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 284/567] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 12:50:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:09.263126 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140bc79-2351-48ac-a074-9f9d20049c2b None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:09.268886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:09.280042 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe781329-9535-4236-88c0-aacc1d93db72 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:09.317516 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdd050-5524-42ba-a861-14aa99a16ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:09.318182 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdd050-5524-42ba-a861-14aa99a16ea2 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:09.318464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdd050-5524-42ba-a861-14aa99a16ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:09.318742 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bdd050-5524-42ba-a861-14aa99a16ea2 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:09.319948 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdd050-5524-42ba-a861-14aa99a16ea2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:09.320264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdd050-5524-42ba-a861-14aa99a16ea2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:09.321724 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bdd050-5524-42ba-a861-14aa99a16ea2 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:09.336938 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 284/568] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:09.337805 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdd050-5524-42ba-a861-14aa99a16ea2 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:09.377223 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0140bc79-2351-48ac-a074-9f9d20049c2b None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:09.413898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493551c-03e0-4973-b706-ba5b165e05c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:09.414762 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493551c-03e0-4973-b706-ba5b165e05c9 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:09.419741 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493551c-03e0-4973-b706-ba5b165e05c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:09.419741 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c493551c-03e0-4973-b706-ba5b165e05c9 None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:09.419741 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493551c-03e0-4973-b706-ba5b165e05c9 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:09.419741 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493551c-03e0-4973-b706-ba5b165e05c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:09.419741 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c493551c-03e0-4973-b706-ba5b165e05c9 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:09.442228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 285/569] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jul 14 12:50:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:09.442228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493551c-03e0-4973-b706-ba5b165e05c9 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:09.457221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bdd050-5524-42ba-a861-14aa99a16ea2 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:09.469703 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:09.499085 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930976c1-660a-4aa3-a31e-365a139cb3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:09.499801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930976c1-660a-4aa3-a31e-365a139cb3cb None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:09.500051 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930976c1-660a-4aa3-a31e-365a139cb3cb None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:09.500323 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930976c1-660a-4aa3-a31e-365a139cb3cb None admin] PATH_INFO: `/v3/users` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:09.501182 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930976c1-660a-4aa3-a31e-365a139cb3cb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:09.501479 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930976c1-660a-4aa3-a31e-365a139cb3cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:09.502908 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930976c1-660a-4aa3-a31e-365a139cb3cb None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:09.526539 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 285/570] 10.222.0.40 () {56 vars in 1139 bytes} [Thu Jul 14 12:50:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:09.526539 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930976c1-660a-4aa3-a31e-365a139cb3cb None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:09.541618 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:09.550157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c493551c-03e0-4973-b706-ba5b165e05c9 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:09.585801 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f691d20-f044-48ea-b953-5da85a6a28eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:09.586605 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f691d20-f044-48ea-b953-5da85a6a28eb None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:09.586890 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f691d20-f044-48ea-b953-5da85a6a28eb None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:09.587184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f691d20-f044-48ea-b953-5da85a6a28eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:09.594826 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f691d20-f044-48ea-b953-5da85a6a28eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:09.596433 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f691d20-f044-48ea-b953-5da85a6a28eb None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:09.610449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-5f691d20-f044-48ea-b953-5da85a6a28eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:09.610449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:09.610449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:09.610449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:09.610449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:09.610449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:09.610449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:09.610449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:09.610449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:09.610449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:09.610449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:09.610449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:09.610449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:50:09.610449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:50:09.610449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:50:09.611599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:50:09.611599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:09.611599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:09.611599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:09.611599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:09.611599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:09.611599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:09.611599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:09.611599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:09.611599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:09.611599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:09.611599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:09.611599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:09.611599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:09.611599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:09.611599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:09.611599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:09.612789 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:50:09.612789 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:50:09.612789 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:50:09.612789 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:50:09.612789 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:50:09.612789 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:50:09.612789 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:09.612789 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:09.616210 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 286/571] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:09.617061 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f691d20-f044-48ea-b953-5da85a6a28eb None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:09.638977 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930976c1-660a-4aa3-a31e-365a139cb3cb None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:09.675705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf1390-e924-43e0-9b9b-741e7bbf024f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:09.677202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf1390-e924-43e0-9b9b-741e7bbf024f None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:09.677645 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf1390-e924-43e0-9b9b-741e7bbf024f None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:09.678320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bf1390-e924-43e0-9b9b-741e7bbf024f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:09.691319 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf1390-e924-43e0-9b9b-741e7bbf024f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:09.692866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bf1390-e924-43e0-9b9b-741e7bbf024f None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:09.712061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-13bf1390-e924-43e0-9b9b-741e7bbf024f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:09.712061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:09.712061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:09.712061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:09.712061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:09.712061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:09.712061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:09.712061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:09.712061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:09.712061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:09.712061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:09.712061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:09.712061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:09.712061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:09.712061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:09.713191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:09.713191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:09.713191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:09.713191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:09.713191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:09.713191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:09.713191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:09.713191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:09.713191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:09.713191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:09.713191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:09.713191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:09.713191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:09.713191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:09.713191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:09.713191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:09.713191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:09.714396 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:09.714396 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:09.714396 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:09.714396 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:09.714396 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 286/572] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:09.714871 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:09.718975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf1390-e924-43e0-9b9b-741e7bbf024f None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:09.727136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f691d20-f044-48ea-b953-5da85a6a28eb None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:09.772682 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3db8e-2d48-4099-9a53-acbf6ebd0eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:09.773577 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3db8e-2d48-4099-9a53-acbf6ebd0eef None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:09.773912 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3db8e-2d48-4099-9a53-acbf6ebd0eef None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:09.774136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3db8e-2d48-4099-9a53-acbf6ebd0eef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:09.785902 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:09.786074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3db8e-2d48-4099-9a53-acbf6ebd0eef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:09.787573 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3db8e-2d48-4099-9a53-acbf6ebd0eef None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:09.805346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-dfd3db8e-2d48-4099-9a53-acbf6ebd0eef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:09.805346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:09.805346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:09.805346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:09.805346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:09.805346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:09.805346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:09.805346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:09.805346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:09.805346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:09.805346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:09.805346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:09.805346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:09.805346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:09.805346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:09.806320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:09.806320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:09.806320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:09.806320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:09.806320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:09.806320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:09.806320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:09.806320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:09.806320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:09.806320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:09.806320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:09.806320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:09.806320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:09.806320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:09.806320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:09.806320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:09.806320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:09.807241 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:09.807241 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:09.807241 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:09.807241 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:09.807241 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 287/573] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:09.807517 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3db8e-2d48-4099-9a53-acbf6ebd0eef None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:09.835504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bf1390-e924-43e0-9b9b-741e7bbf024f None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:09.871823 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41bc44-376f-414b-865a-e595668502bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:09.872536 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41bc44-376f-414b-865a-e595668502bd None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:09.872852 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41bc44-376f-414b-865a-e595668502bd None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:09.873181 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef41bc44-376f-414b-865a-e595668502bd None admin] PATH_INFO: `/v3/projects` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:09.873972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41bc44-376f-414b-865a-e595668502bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:09.874813 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41bc44-376f-414b-865a-e595668502bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:09.876280 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef41bc44-376f-414b-865a-e595668502bd None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:09.888446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 287/574] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:50:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:09.889312 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41bc44-376f-414b-865a-e595668502bd None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:09.933126 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3db8e-2d48-4099-9a53-acbf6ebd0eef None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:09.972077 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebed44-8f86-4fd5-8903-81e4ff4350bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:09.972692 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebed44-8f86-4fd5-8903-81e4ff4350bb None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:09.972983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebed44-8f86-4fd5-8903-81e4ff4350bb None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:09.973269 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebed44-8f86-4fd5-8903-81e4ff4350bb None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:09.974002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebed44-8f86-4fd5-8903-81e4ff4350bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:09.974312 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebed44-8f86-4fd5-8903-81e4ff4350bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:09.975777 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebed44-8f86-4fd5-8903-81e4ff4350bb None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:09.985377 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:09.993862 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 288/575] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:09.993862 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebed44-8f86-4fd5-8903-81e4ff4350bb None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:10.018810 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef41bc44-376f-414b-865a-e595668502bd None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:10.044164 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:10.059614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e061bbd-88d5-4c59-90f0-9c11ef7367fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:10.060389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e061bbd-88d5-4c59-90f0-9c11ef7367fa None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:10.060710 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e061bbd-88d5-4c59-90f0-9c11ef7367fa None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:10.060993 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e061bbd-88d5-4c59-90f0-9c11ef7367fa None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:10.061739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e061bbd-88d5-4c59-90f0-9c11ef7367fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:10.062046 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e061bbd-88d5-4c59-90f0-9c11ef7367fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:10.063417 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e061bbd-88d5-4c59-90f0-9c11ef7367fa None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:10.082704 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 288/576] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:10.084581 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e061bbd-88d5-4c59-90f0-9c11ef7367fa None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:10.099949 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebed44-8f86-4fd5-8903-81e4ff4350bb None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:10.144743 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ae83b-522a-448e-93ba-b49d0ed66368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:10.145643 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ae83b-522a-448e-93ba-b49d0ed66368 None admin] REQUEST_METHOD: `PUT` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:10.145927 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ae83b-522a-448e-93ba-b49d0ed66368 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:10.146207 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7ae83b-522a-448e-93ba-b49d0ed66368 None admin] PATH_INFO: `/v3/projects/2a58a74d443e40a782112277c58028b6/users/b8ba3c2afa1e4499bafda337dc4dc2a9/roles/f38b25010c404af5bbde51980f7e8dec` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:10.162491 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ae83b-522a-448e-93ba-b49d0ed66368 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a58a74d443e40a782112277c58028b6, user_id=b8ba3c2afa1e4499bafda337dc4dc2a9, role_id=f38b25010c404af5bbde51980f7e8dec)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:10.163956 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7ae83b-522a-448e-93ba-b49d0ed66368 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:10.197383 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e061bbd-88d5-4c59-90f0-9c11ef7367fa None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:10.226404 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 289/577] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 12:50:09 2022] PUT /identity/v3/projects/2a58a74d443e40a782112277c58028b6/users/b8ba3c2afa1e4499bafda337dc4dc2a9/roles/f38b25010c404af5bbde51980f7e8dec => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:50:10.227520 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ae83b-522a-448e-93ba-b49d0ed66368 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:10.244787 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa8c4a-0da7-4723-8340-a68d699c1b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:10.246624 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa8c4a-0da7-4723-8340-a68d699c1b83 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:10.247157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa8c4a-0da7-4723-8340-a68d699c1b83 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:10.247590 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa8c4a-0da7-4723-8340-a68d699c1b83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:10.258355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa8c4a-0da7-4723-8340-a68d699c1b83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:10.260555 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa8c4a-0da7-4723-8340-a68d699c1b83 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:10.280714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-1dfa8c4a-0da7-4723-8340-a68d699c1b83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:10.280714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:10.280714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:10.280714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:10.280714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:10.280714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:10.280714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:10.280714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:10.280714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:10.280714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:10.280714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:10.280714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:10.280714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:50:10.280714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:50:10.280714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:50:10.281890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:50:10.281890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:10.281890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:10.281890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:10.281890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:10.281890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:10.281890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:10.281890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:10.281890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:10.281890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:10.281890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:10.281890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:10.281890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:10.281890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:10.281890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:10.281890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:10.281890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:10.283037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:50:10.283037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:50:10.283037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:50:10.283037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:50:10.283037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:50:10.283037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:50:10.283037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:10.283037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:10.286361 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 289/578] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:10.291966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa8c4a-0da7-4723-8340-a68d699c1b83 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:10.313516 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:10.356860 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:10.376850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7ae83b-522a-448e-93ba-b49d0ed66368 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:10.419463 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47dd8ba-d794-44c3-8bec-4889be8bf83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:10.420231 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dd8ba-d794-44c3-8bec-4889be8bf83f None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:10.420490 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dd8ba-d794-44c3-8bec-4889be8bf83f None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:10.420810 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47dd8ba-d794-44c3-8bec-4889be8bf83f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:10.433422 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47dd8ba-d794-44c3-8bec-4889be8bf83f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:10.434471 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47dd8ba-d794-44c3-8bec-4889be8bf83f None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:10.435947 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa8c4a-0da7-4723-8340-a68d699c1b83 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:10.451287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-d47dd8ba-d794-44c3-8bec-4889be8bf83f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:10.451287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:10.451287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:10.451287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:10.451287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:10.451287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:10.451287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:10.451287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:10.451287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:10.451287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:10.451287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:10.451287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:10.451287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:50:10.451287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:50:10.451287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:50:10.452236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:50:10.452236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:10.452236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:10.452236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:10.452236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:10.452236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:10.452236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:10.452236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:10.452236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:10.452236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:10.452236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:10.452236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:10.452236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:10.452236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:10.452236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:10.452236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:10.452236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:10.453188 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:50:10.453188 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:50:10.453188 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:50:10.453188 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:50:10.453188 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:50:10.453188 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:50:10.453188 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:10.453188 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:10.453188 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 290/579] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:10.459779 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47dd8ba-d794-44c3-8bec-4889be8bf83f None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:10.482860 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f683cd9a-cccb-4209-99d9-daadf22fb6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:10.483446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683cd9a-cccb-4209-99d9-daadf22fb6b7 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:10.484315 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683cd9a-cccb-4209-99d9-daadf22fb6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:10.484603 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f683cd9a-cccb-4209-99d9-daadf22fb6b7 None admin] PATH_INFO: `/v3/projects` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:10.485445 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683cd9a-cccb-4209-99d9-daadf22fb6b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:10.485758 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683cd9a-cccb-4209-99d9-daadf22fb6b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:10.487255 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f683cd9a-cccb-4209-99d9-daadf22fb6b7 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:10.501486 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 290/580] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:50:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:50:10.502859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d7b78-dbbf-4dbd-954e-ebff68ed9611 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:10.503152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d7b78-dbbf-4dbd-954e-ebff68ed9611 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:10.503426 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d7b78-dbbf-4dbd-954e-ebff68ed9611 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:10.504923 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 291/581] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:10.509514 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d7b78-dbbf-4dbd-954e-ebff68ed9611 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:10.573136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47dd8ba-d794-44c3-8bec-4889be8bf83f None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:10.584346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:10.611590 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a753d429-e322-482c-a698-c1362746defa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:10.612332 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753d429-e322-482c-a698-c1362746defa None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:10.612723 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753d429-e322-482c-a698-c1362746defa None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:10.613084 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a753d429-e322-482c-a698-c1362746defa None admin] PATH_INFO: `/v3/projects` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:10.613940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753d429-e322-482c-a698-c1362746defa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:10.614349 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753d429-e322-482c-a698-c1362746defa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:10.615807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a753d429-e322-482c-a698-c1362746defa None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:10.617615 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:10.621979 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d7b78-dbbf-4dbd-954e-ebff68ed9611 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:10.629773 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 291/582] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:50:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:50:10.631743 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695e523-1a20-4d53-bc4e-8451dec00545 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:10.632181 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695e523-1a20-4d53-bc4e-8451dec00545 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:10.632588 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b695e523-1a20-4d53-bc4e-8451dec00545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:10.651462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-b695e523-1a20-4d53-bc4e-8451dec00545 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:10.654485 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-b695e523-1a20-4d53-bc4e-8451dec00545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:10.659128 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e920b0-c47b-49e8-bc3f-2be8e4ce237c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:10.660143 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e920b0-c47b-49e8-bc3f-2be8e4ce237c None admin] REQUEST_METHOD: `PUT` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:10.660445 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e920b0-c47b-49e8-bc3f-2be8e4ce237c None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:10.660718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e920b0-c47b-49e8-bc3f-2be8e4ce237c None admin] PATH_INFO: `/v3/projects/2a58a74d443e40a782112277c58028b6/users/efbe88187dd84518818114165f60a5ef/roles/f38b25010c404af5bbde51980f7e8dec` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:10.678411 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e920b0-c47b-49e8-bc3f-2be8e4ce237c None admin] RBAC: Authorizing `identity:create_grant(project_id=2a58a74d443e40a782112277c58028b6, user_id=efbe88187dd84518818114165f60a5ef, role_id=f38b25010c404af5bbde51980f7e8dec)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:10.681364 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e920b0-c47b-49e8-bc3f-2be8e4ce237c None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:10.725006 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 292/583] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:50:10.725911 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695e523-1a20-4d53-bc4e-8451dec00545 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:10.802728 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 292/584] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 12:50:10 2022] PUT /identity/v3/projects/2a58a74d443e40a782112277c58028b6/users/efbe88187dd84518818114165f60a5ef/roles/f38b25010c404af5bbde51980f7e8dec => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:50:10.803721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e920b0-c47b-49e8-bc3f-2be8e4ce237c None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:10.850698 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:10.855319 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b695e523-1a20-4d53-bc4e-8451dec00545 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:10.896014 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c287cb-93f5-436a-b208-4bd6f2ae82a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:10.897158 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c287cb-93f5-436a-b208-4bd6f2ae82a3 None admin] REQUEST_METHOD: `PUT` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:10.897538 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c287cb-93f5-436a-b208-4bd6f2ae82a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:10.897930 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c287cb-93f5-436a-b208-4bd6f2ae82a3 None admin] PATH_INFO: `/v3/projects/2a58a74d443e40a782112277c58028b6/users/513bc0a2d10240a5bc12cb402da41faf/roles/f38b25010c404af5bbde51980f7e8dec` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:10.919165 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c287cb-93f5-436a-b208-4bd6f2ae82a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a58a74d443e40a782112277c58028b6, user_id=513bc0a2d10240a5bc12cb402da41faf, role_id=f38b25010c404af5bbde51980f7e8dec)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:10.922234 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c287cb-93f5-436a-b208-4bd6f2ae82a3 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:10.933581 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e920b0-c47b-49e8-bc3f-2be8e4ce237c None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:10.975101 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242a8ca-e0a0-403f-8e9b-7fd98b9e7ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:10.975983 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242a8ca-e0a0-403f-8e9b-7fd98b9e7ca5 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:10.976242 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242a8ca-e0a0-403f-8e9b-7fd98b9e7ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:10.976486 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2242a8ca-e0a0-403f-8e9b-7fd98b9e7ca5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:10.990930 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2242a8ca-e0a0-403f-8e9b-7fd98b9e7ca5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:50:10.995570 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 293/585] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 12:50:10 2022] PUT /identity/v3/projects/2a58a74d443e40a782112277c58028b6/users/513bc0a2d10240a5bc12cb402da41faf/roles/f38b25010c404af5bbde51980f7e8dec => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:50:11.004749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-2242a8ca-e0a0-403f-8e9b-7fd98b9e7ca5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:11.004749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:11.004749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:11.004749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:11.004749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:11.004749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:11.004749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:11.004749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:11.004749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:11.004749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:11.004749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:11.004749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:11.004749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:50:11.004749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:50:11.004749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:50:11.004749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:50:11.005801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:50:11.005801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:50:11.005801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:50:11.005801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:50:11.005801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:11.005801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:11.005801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:11.005801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:11.005801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:11.005801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:11.005801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:11.005801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:11.005801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:11.005801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:11.005801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:11.005801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:11.006746 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:11.006746 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:11.006746 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:11.006746 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:11.006746 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:50:11.006746 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:50:11.006746 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:50:11.006746 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:50:11.006746 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:50:11.006746 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:50:11.006746 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:11.006746 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:11.006746 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 293/586] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 12:50:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:11.012341 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c287cb-93f5-436a-b208-4bd6f2ae82a3 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:11.135162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c287cb-93f5-436a-b208-4bd6f2ae82a3 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:11.175670 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba419e-8381-4d8a-b0cd-9aca464b1f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:11.176352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba419e-8381-4d8a-b0cd-9aca464b1f59 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:11.176658 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba419e-8381-4d8a-b0cd-9aca464b1f59 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:11.177009 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ba419e-8381-4d8a-b0cd-9aca464b1f59 None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:11.177785 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba419e-8381-4d8a-b0cd-9aca464b1f59 None admin] RBAC: Adding query filter params (name=service) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:11.178094 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba419e-8381-4d8a-b0cd-9aca464b1f59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:11.180128 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ba419e-8381-4d8a-b0cd-9aca464b1f59 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:11.190756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 294/587] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 12:50:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:11.195438 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242a8ca-e0a0-403f-8e9b-7fd98b9e7ca5 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:11.210674 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:11.311345 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2242a8ca-e0a0-403f-8e9b-7fd98b9e7ca5 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:11.347847 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c20ce-a45e-4ac9-b6ee-70afc8e567e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:11.349100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c20ce-a45e-4ac9-b6ee-70afc8e567e1 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:11.349623 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c20ce-a45e-4ac9-b6ee-70afc8e567e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:11.350103 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c20ce-a45e-4ac9-b6ee-70afc8e567e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:11.361876 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c20ce-a45e-4ac9-b6ee-70afc8e567e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:11.363635 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c20ce-a45e-4ac9-b6ee-70afc8e567e1 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:11.382692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-ab5c20ce-a45e-4ac9-b6ee-70afc8e567e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:11.382692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:11.382692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:11.382692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:11.382692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:11.382692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:11.382692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:11.382692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:11.382692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:11.382692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:11.382692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:11.382692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:11.382692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:11.382692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:11.382692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:11.383639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:11.383639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:11.383639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:11.383639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:11.383639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:11.383639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:11.383639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:11.383639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:11.383639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:11.383639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:11.383639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:11.383639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:11.383639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:11.383639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:11.383639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:11.383639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:11.383639 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:11.384574 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:11.384574 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:11.384574 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:11.384574 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:11.386959 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 294/588] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:11.392682 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba419e-8381-4d8a-b0cd-9aca464b1f59 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:11.408991 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:11.509071 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ba419e-8381-4d8a-b0cd-9aca464b1f59 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:11.546962 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00204974-2d39-4af4-841d-e9b6f71d04b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:11.547632 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00204974-2d39-4af4-841d-e9b6f71d04b4 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:11.547964 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00204974-2d39-4af4-841d-e9b6f71d04b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:11.548245 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00204974-2d39-4af4-841d-e9b6f71d04b4 None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:11.548997 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00204974-2d39-4af4-841d-e9b6f71d04b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:11.549308 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00204974-2d39-4af4-841d-e9b6f71d04b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:11.550684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00204974-2d39-4af4-841d-e9b6f71d04b4 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:11.568077 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 295/589] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:11.569598 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c20ce-a45e-4ac9-b6ee-70afc8e567e1 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:11.636377 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:11.678106 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c20ce-a45e-4ac9-b6ee-70afc8e567e1 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:11.717906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af424a-08e4-4af3-9e19-f03b1959fbcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:11.719046 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af424a-08e4-4af3-9e19-f03b1959fbcd None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:11.719511 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af424a-08e4-4af3-9e19-f03b1959fbcd None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:11.719939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47af424a-08e4-4af3-9e19-f03b1959fbcd None admin] PATH_INFO: `/v3/users/nova` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:11.728013 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af424a-08e4-4af3-9e19-f03b1959fbcd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:11.729650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47af424a-08e4-4af3-9e19-f03b1959fbcd None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:11.744403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-47af424a-08e4-4af3-9e19-f03b1959fbcd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 12:50:11.744403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:11.744403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:11.744403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:11.744403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:11.744403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:11.744403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:11.744403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:11.744403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:11.744403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:11.744403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:11.744403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:11.744403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:50:11.744403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:50:11.744403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:50:11.744403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:50:11.745564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:11.745564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:11.745564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:50:11.745564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:11.745564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:50:11.745564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:11.745564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:11.745564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:11.745564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:11.745564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:11.745564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:11.745564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:11.745564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:11.745564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:11.745564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:11.745564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:11.745564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:11.745564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:11.746717 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:11.746717 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:11.746717 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:50:11.746717 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:50:11.746717 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:50:11.746717 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:50:11.746717 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:50:11.746717 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:50:11.746717 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 12:50:11.746717 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:11.749032 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 295/590] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 14 12:50:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:11.754601 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00204974-2d39-4af4-841d-e9b6f71d04b4 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:11.840002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:11.872573 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00204974-2d39-4af4-841d-e9b6f71d04b4 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:11.909436 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a76c1-4293-43c9-9927-c74eb4822aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:11.910332 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a76c1-4293-43c9-9927-c74eb4822aad None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:11.910788 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a76c1-4293-43c9-9927-c74eb4822aad None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:11.911215 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a76c1-4293-43c9-9927-c74eb4822aad None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:11.912202 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a76c1-4293-43c9-9927-c74eb4822aad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:11.912685 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a76c1-4293-43c9-9927-c74eb4822aad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:11.914292 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9a76c1-4293-43c9-9927-c74eb4822aad None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:11.933403 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 296/591] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 14 12:50:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:11.939330 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af424a-08e4-4af3-9e19-f03b1959fbcd None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:12.042015 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47af424a-08e4-4af3-9e19-f03b1959fbcd None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:12.071753 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:12.085908 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258034d-1080-474d-a560-2d3361d14037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:12.087290 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258034d-1080-474d-a560-2d3361d14037 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:12.093415 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258034d-1080-474d-a560-2d3361d14037 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:12.093415 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d258034d-1080-474d-a560-2d3361d14037 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:12.169126 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258034d-1080-474d-a560-2d3361d14037 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:12.171173 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d258034d-1080-474d-a560-2d3361d14037 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:12.282617 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 296/592] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:50:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:50:12.286275 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a76c1-4293-43c9-9927-c74eb4822aad None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:12.395639 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a76c1-4293-43c9-9927-c74eb4822aad None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:12.427611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:12.434135 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67e98d-6f35-4df5-b6bc-f8db9342dd94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:12.434935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67e98d-6f35-4df5-b6bc-f8db9342dd94 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:12.435221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67e98d-6f35-4df5-b6bc-f8db9342dd94 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:12.435498 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67e98d-6f35-4df5-b6bc-f8db9342dd94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:12.446867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67e98d-6f35-4df5-b6bc-f8db9342dd94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:12.448356 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67e98d-6f35-4df5-b6bc-f8db9342dd94 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:12.470759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-0f67e98d-6f35-4df5-b6bc-f8db9342dd94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:12.470759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:12.470759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:12.470759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:12.470759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:12.470759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:12.470759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:12.470759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:12.470759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:12.470759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:12.470759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:12.470759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:12.470759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:12.470759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:12.470759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:12.471700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:12.471700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:12.471700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:12.471700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:12.471700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:12.471700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:12.471700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:12.471700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:12.471700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:12.471700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:12.471700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:12.471700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:12.471700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:12.471700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:12.471700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:12.471700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:12.471700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:12.473059 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:12.473059 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:12.473059 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:12.473059 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:12.473059 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 297/593] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:12.478314 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258034d-1080-474d-a560-2d3361d14037 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:12.508036 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:12.591708 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d258034d-1080-474d-a560-2d3361d14037 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:12.628060 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b85e23-74ac-4e1e-a846-7c51715aea72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:12.629091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b85e23-74ac-4e1e-a846-7c51715aea72 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:12.629576 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b85e23-74ac-4e1e-a846-7c51715aea72 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:12.630068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b85e23-74ac-4e1e-a846-7c51715aea72 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:12.630988 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b85e23-74ac-4e1e-a846-7c51715aea72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:12.631501 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b85e23-74ac-4e1e-a846-7c51715aea72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:12.633156 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b85e23-74ac-4e1e-a846-7c51715aea72 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:12.645668 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 297/594] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:12.656658 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67e98d-6f35-4df5-b6bc-f8db9342dd94 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:12.674618 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a3495-01f2-46ea-bf58-a19554439483 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:12.674923 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a3495-01f2-46ea-bf58-a19554439483 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:12.675185 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a3495-01f2-46ea-bf58-a19554439483 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:12.677865 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 298/595] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:50:12.683082 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f265748-795a-4170-ba05-587689a20c88 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:12.683379 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f265748-795a-4170-ba05-587689a20c88 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:12.683661 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f265748-795a-4170-ba05-587689a20c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:12.704263 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-0f265748-795a-4170-ba05-587689a20c88 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:12.706249 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-0f265748-795a-4170-ba05-587689a20c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:12.767659 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67e98d-6f35-4df5-b6bc-f8db9342dd94 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:12.804792 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 299/596] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:50:12.810290 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3ba7e-c5eb-447c-b243-ec7f543b1506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:12.811095 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3ba7e-c5eb-447c-b243-ec7f543b1506 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:12.811379 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3ba7e-c5eb-447c-b243-ec7f543b1506 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:12.811657 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3ba7e-c5eb-447c-b243-ec7f543b1506 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:12.819741 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3ba7e-c5eb-447c-b243-ec7f543b1506 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:12.821238 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3ba7e-c5eb-447c-b243-ec7f543b1506 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:12.829298 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f265748-795a-4170-ba05-587689a20c88 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:12.836721 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-fca3ba7e-c5eb-447c-b243-ec7f543b1506 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:12.836721 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:12.836721 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:12.836721 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:12.836721 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:12.836721 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:12.836721 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:12.836721 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:12.836721 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:12.836721 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:12.836721 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:12.836721 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:12.836721 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:50:12.836721 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:50:12.836721 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:50:12.838708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:50:12.838708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:12.838708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:12.838708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:12.838708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:12.838708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:12.838708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:12.838708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:12.838708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:12.838708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:12.838708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:12.838708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:12.838708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:12.838708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:12.838708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:12.838708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:12.838708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:12.840780 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:50:12.840780 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:50:12.840780 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:50:12.840780 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:50:12.840780 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:50:12.840780 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:50:12.840780 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:12.840780 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:12.848676 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 298/597] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:12.848676 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3ba7e-c5eb-447c-b243-ec7f543b1506 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:12.849010 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:12.895339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:12.961114 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3ba7e-c5eb-447c-b243-ec7f543b1506 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:12.961987 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f265748-795a-4170-ba05-587689a20c88 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:12.998823 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64b7d7-cfe6-46e1-9434-4ad40e70af23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:13.000143 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64b7d7-cfe6-46e1-9434-4ad40e70af23 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:13.000493 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64b7d7-cfe6-46e1-9434-4ad40e70af23 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:13.000722 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df64b7d7-cfe6-46e1-9434-4ad40e70af23 None admin] PATH_INFO: `/v3/projects` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:13.001607 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64b7d7-cfe6-46e1-9434-4ad40e70af23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:13.001919 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64b7d7-cfe6-46e1-9434-4ad40e70af23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:13.003621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df64b7d7-cfe6-46e1-9434-4ad40e70af23 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:13.009130 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4714140-d8e8-43f4-b221-c9d6549c3a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:13.010150 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4714140-d8e8-43f4-b221-c9d6549c3a9f None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:13.010586 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4714140-d8e8-43f4-b221-c9d6549c3a9f None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:13.011011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4714140-d8e8-43f4-b221-c9d6549c3a9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:13.022746 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 299/598] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:50:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:50:13.023768 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4714140-d8e8-43f4-b221-c9d6549c3a9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:50:13.024133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64b7d7-cfe6-46e1-9434-4ad40e70af23 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:13.034117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-b4714140-d8e8-43f4-b221-c9d6549c3a9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:13.034117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:13.034117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:13.034117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:13.034117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:13.034117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:13.034117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:13.034117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:13.034117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:13.034117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:13.034117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:13.034117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:13.034117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:50:13.034117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:50:13.034117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:50:13.034117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:50:13.035289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:50:13.035289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:50:13.035289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:50:13.035289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:50:13.035289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:13.035289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:13.035289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:13.035289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:13.035289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:13.035289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:13.035289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:13.035289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:13.035289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:13.035289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:13.035289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:13.035289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:13.036345 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:13.036345 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:13.036345 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:13.036345 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:13.036345 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:50:13.036345 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:50:13.036345 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:50:13.036345 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:50:13.036345 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:50:13.036345 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:50:13.036345 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:13.036345 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:13.040456 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 300/599] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 12:50:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:50:13.044405 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4714140-d8e8-43f4-b221-c9d6549c3a9f None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:13.125962 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:13.163077 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4714140-d8e8-43f4-b221-c9d6549c3a9f None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:13.166944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df64b7d7-cfe6-46e1-9434-4ad40e70af23 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:13.168903 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:13.200439 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8cc07-96fe-4778-a347-40796bfcec90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:13.201146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8cc07-96fe-4778-a347-40796bfcec90 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:13.201430 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8cc07-96fe-4778-a347-40796bfcec90 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:13.201826 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b8cc07-96fe-4778-a347-40796bfcec90 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:13.202595 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8cc07-96fe-4778-a347-40796bfcec90 None admin] RBAC: Adding query filter params (name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:13.202904 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8cc07-96fe-4778-a347-40796bfcec90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:13.204293 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b8cc07-96fe-4778-a347-40796bfcec90 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:13.219072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 301/600] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 12:50:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:13.219231 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743fa2bc-40df-43cf-a75f-dee9ae826fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:13.219231 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fa2bc-40df-43cf-a75f-dee9ae826fd0 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:13.219231 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fa2bc-40df-43cf-a75f-dee9ae826fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:13.219231 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743fa2bc-40df-43cf-a75f-dee9ae826fd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:13.219536 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fa2bc-40df-43cf-a75f-dee9ae826fd0 None admin] RBAC: Adding query filter params (role.id=f38b25010c404af5bbde51980f7e8dec, scope.project.id=2a58a74d443e40a782112277c58028b6, user.id=1faa19de04744a4084a9c60c4af64f3e) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:13.219606 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fa2bc-40df-43cf-a75f-dee9ae826fd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:13.220784 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8cc07-96fe-4778-a347-40796bfcec90 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:13.222281 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743fa2bc-40df-43cf-a75f-dee9ae826fd0 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:13.230901 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 300/601] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:50:13 2022] GET /identity/v3/role_assignments?user.id=1faa19de04744a4084a9c60c4af64f3e&scope.project.id=2a58a74d443e40a782112277c58028b6&role.id=f38b25010c404af5bbde51980f7e8dec => generated 608 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:50:13.251592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecf748-2d40-4387-8531-ec12df298b7f None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:13.251788 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecf748-2d40-4387-8531-ec12df298b7f None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:13.252017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ecf748-2d40-4387-8531-ec12df298b7f None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:13.253778 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 301/602] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:50:13.259353 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e9007-886f-4eae-bca5-47495efd6209 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:13.259666 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e9007-886f-4eae-bca5-47495efd6209 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:13.260034 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282e9007-886f-4eae-bca5-47495efd6209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:13.278187 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-282e9007-886f-4eae-bca5-47495efd6209 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:13.279410 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-282e9007-886f-4eae-bca5-47495efd6209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:13.352185 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b8cc07-96fe-4778-a347-40796bfcec90 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:13.376869 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 302/603] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:50:13.396208 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9772b96-1c34-47ce-8223-e1e77169598a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:13.397514 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9772b96-1c34-47ce-8223-e1e77169598a None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:13.398034 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9772b96-1c34-47ce-8223-e1e77169598a None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:13.398521 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9772b96-1c34-47ce-8223-e1e77169598a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:13.401727 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:13.403079 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e9007-886f-4eae-bca5-47495efd6209 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:13.422128 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9772b96-1c34-47ce-8223-e1e77169598a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:13.424079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9772b96-1c34-47ce-8223-e1e77169598a None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:13.451480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-e9772b96-1c34-47ce-8223-e1e77169598a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:13.451480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:13.451480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:13.451480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:13.451480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:13.451480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:13.451480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:13.451480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:13.451480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:13.451480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:13.451480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:13.451480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:13.451480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:13.451480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:13.451480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:13.453506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:13.453506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:13.453506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:13.453506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:13.453506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:13.453506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:13.453506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:13.453506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:13.453506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:13.453506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:13.453506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:13.453506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:13.453506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:13.453506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:13.453506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:13.453506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:13.453506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:13.456074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:13.456074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:13.456074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:13.456074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:13.456074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 302/604] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:50:13.456074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9772b96-1c34-47ce-8223-e1e77169598a None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:13.537039 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:13.543397 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282e9007-886f-4eae-bca5-47495efd6209 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:13.576989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9772b96-1c34-47ce-8223-e1e77169598a None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:13.582095 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2b04d-a88a-4a02-9fb4-e8ac944673af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:13.582897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2b04d-a88a-4a02-9fb4-e8ac944673af None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:13.583179 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2b04d-a88a-4a02-9fb4-e8ac944673af None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:13.583448 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2b04d-a88a-4a02-9fb4-e8ac944673af None admin] PATH_INFO: `/v3/roles/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:13.596105 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2b04d-a88a-4a02-9fb4-e8ac944673af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:50:13.604045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-98d2b04d-a88a-4a02-9fb4-e8ac944673af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:13.604045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:13.604045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:13.604045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:13.604045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:13.604045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:13.604045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:13.604045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:13.604045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:13.604045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:13.604045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:13.604045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:13.604045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:50:13.604045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:50:13.604045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:50:13.604045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:50:13.605075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:50:13.605075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:50:13.605075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:50:13.605075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:50:13.605075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:13.605075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:13.605075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:13.605075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:13.605075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:13.605075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:13.605075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:13.605075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:13.605075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:13.605075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:13.605075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:13.605075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:13.605915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:13.605915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:13.605915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:13.605915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:13.605915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:50:13.605915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:50:13.605915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:50:13.605915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:50:13.605915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:50:13.605915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:50:13.605915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:13.605915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:13.605915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 303/605] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 12:50:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:13.611642 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c6eca-46f2-4bff-afee-38e469816284 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:13.611642 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c6eca-46f2-4bff-afee-38e469816284 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:13.611642 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c6eca-46f2-4bff-afee-38e469816284 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:13.611642 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 304/606] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:13.617530 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c6eca-46f2-4bff-afee-38e469816284 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:13.617812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c03597-771c-43a4-a1d0-4d20e09954d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:13.617812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c03597-771c-43a4-a1d0-4d20e09954d3 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:13.617812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c03597-771c-43a4-a1d0-4d20e09954d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:13.617812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c03597-771c-43a4-a1d0-4d20e09954d3 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:13.618152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c03597-771c-43a4-a1d0-4d20e09954d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:13.618152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c03597-771c-43a4-a1d0-4d20e09954d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:13.619211 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c03597-771c-43a4-a1d0-4d20e09954d3 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:13.632138 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 303/607] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:13.633525 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bf65c-e844-4390-8bc8-97124f31434f None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:13.633823 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bf65c-e844-4390-8bc8-97124f31434f None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:13.634100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9bf65c-e844-4390-8bc8-97124f31434f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:13.655020 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-ce9bf65c-e844-4390-8bc8-97124f31434f None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:13.656237 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-ce9bf65c-e844-4390-8bc8-97124f31434f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:13.703550 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:13.733318 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 304/608] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:50:13.734248 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bf65c-e844-4390-8bc8-97124f31434f None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:13.744127 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c6eca-46f2-4bff-afee-38e469816284 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:13.796689 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309d677-516c-460d-ba21-52f55d282ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:13.797378 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309d677-516c-460d-ba21-52f55d282ec2 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:13.797666 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309d677-516c-460d-ba21-52f55d282ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:13.798217 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6309d677-516c-460d-ba21-52f55d282ec2 None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:13.798689 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309d677-516c-460d-ba21-52f55d282ec2 None admin] RBAC: Adding query filter params (name=service) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:13.798996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309d677-516c-460d-ba21-52f55d282ec2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:13.800458 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6309d677-516c-460d-ba21-52f55d282ec2 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:13.809534 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 305/609] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 12:50:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:13.809836 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309d677-516c-460d-ba21-52f55d282ec2 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:13.834660 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:13.851987 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9bf65c-e844-4390-8bc8-97124f31434f None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:13.889165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c734cb0-fc73-48ff-bd52-3c8df9c133c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:13.889994 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c734cb0-fc73-48ff-bd52-3c8df9c133c2 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:13.890283 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c734cb0-fc73-48ff-bd52-3c8df9c133c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:13.890561 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c734cb0-fc73-48ff-bd52-3c8df9c133c2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:13.898141 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c734cb0-fc73-48ff-bd52-3c8df9c133c2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:13.899589 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c734cb0-fc73-48ff-bd52-3c8df9c133c2 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:13.915389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-0c734cb0-fc73-48ff-bd52-3c8df9c133c2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 14 12:50:13.915389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:13.915389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:13.915389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:13.915389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:13.915389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:13.915389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:13.915389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:13.915389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:13.915389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:13.915389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:13.915389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:13.915389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:50:13.915389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:50:13.915389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:50:13.915389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:50:13.916376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:13.916376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:13.916376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:50:13.916376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:13.916376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:50:13.916376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:13.916376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:13.916376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:13.916376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:13.916376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:13.916376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:13.916376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:13.916376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:13.916376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:13.916376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:13.916376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:13.916376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:13.916376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:13.917446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:13.917446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:13.917446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:50:13.917446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:50:13.917446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:50:13.917446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:50:13.917446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:50:13.917446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:50:13.917446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 14 12:50:13.917446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:13.917446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 305/610] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:50:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:13.917446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c734cb0-fc73-48ff-bd52-3c8df9c133c2 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:13.923311 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6309d677-516c-460d-ba21-52f55d282ec2 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:13.959391 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:13.963049 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06eb8e7-70b9-456a-822f-e2ccff3bcc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:13.963853 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06eb8e7-70b9-456a-822f-e2ccff3bcc31 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:13.964138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06eb8e7-70b9-456a-822f-e2ccff3bcc31 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:13.964418 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06eb8e7-70b9-456a-822f-e2ccff3bcc31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:13.978520 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06eb8e7-70b9-456a-822f-e2ccff3bcc31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:50:13.989477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-d06eb8e7-70b9-456a-822f-e2ccff3bcc31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:13.989477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:13.989477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:13.989477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:13.989477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:13.989477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:13.989477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:13.989477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:13.989477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:13.989477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:13.989477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:13.989477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:13.989477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:50:13.989477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:50:13.989477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:50:13.989477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:50:13.990610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:50:13.990610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:50:13.990610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:50:13.990610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:50:13.990610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:13.990610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:13.990610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:13.990610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:13.990610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:13.990610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:13.990610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:13.990610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:13.990610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:13.990610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:13.990610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:13.990610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:13.991857 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:13.991857 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:13.991857 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:13.991857 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:13.991857 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:50:13.991857 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:50:13.991857 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:50:13.991857 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:50:13.991857 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:50:13.991857 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:50:13.991857 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:50:13.991857 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:13.991857 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 306/611] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 12:50:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:13.992628 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06eb8e7-70b9-456a-822f-e2ccff3bcc31 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:14.030654 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c734cb0-fc73-48ff-bd52-3c8df9c133c2 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:14.068383 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5dda7-e141-49d2-b2ea-6046350fdd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:14.069261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5dda7-e141-49d2-b2ea-6046350fdd2c None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:14.069619 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5dda7-e141-49d2-b2ea-6046350fdd2c None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:14.069902 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5dda7-e141-49d2-b2ea-6046350fdd2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:14.085203 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5dda7-e141-49d2-b2ea-6046350fdd2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:14.086783 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5dda7-e141-49d2-b2ea-6046350fdd2c None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:14.097700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:14.110886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-fcf5dda7-e141-49d2-b2ea-6046350fdd2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:14.110886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:14.110886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:14.110886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:14.110886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:14.110886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:14.110886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:14.110886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:14.110886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:14.110886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:14.110886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:14.110886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:14.110886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:14.110886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:14.110886 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:14.113859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:14.113859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:14.113859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:14.113859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:14.113859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:14.113859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:14.113859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:14.113859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:14.113859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:14.113859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:14.113859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:14.113859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:14.113859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:14.113859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:14.113859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:14.113859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:14.113859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:14.114979 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:14.114979 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:14.114979 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:14.114979 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:14.114979 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 306/612] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:14.114979 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5dda7-e141-49d2-b2ea-6046350fdd2c None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:14.131401 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06eb8e7-70b9-456a-822f-e2ccff3bcc31 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:14.171529 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250ba34-a0fa-4bb6-90a6-46cb1c460574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:14.172225 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250ba34-a0fa-4bb6-90a6-46cb1c460574 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:14.172510 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250ba34-a0fa-4bb6-90a6-46cb1c460574 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:14.172817 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c250ba34-a0fa-4bb6-90a6-46cb1c460574 None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:14.173649 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250ba34-a0fa-4bb6-90a6-46cb1c460574 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:14.174009 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250ba34-a0fa-4bb6-90a6-46cb1c460574 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:14.175422 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c250ba34-a0fa-4bb6-90a6-46cb1c460574 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:14.198112 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 307/613] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jul 14 12:50:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:14.198112 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250ba34-a0fa-4bb6-90a6-46cb1c460574 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:14.224297 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:14.236065 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5dda7-e141-49d2-b2ea-6046350fdd2c None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:14.271091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59be277-fbff-4f88-a39e-4e14ddf69a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:14.271847 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59be277-fbff-4f88-a39e-4e14ddf69a00 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:14.272079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59be277-fbff-4f88-a39e-4e14ddf69a00 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:14.272395 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59be277-fbff-4f88-a39e-4e14ddf69a00 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:14.273163 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59be277-fbff-4f88-a39e-4e14ddf69a00 None admin] RBAC: Adding query filter params (name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:14.273466 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59be277-fbff-4f88-a39e-4e14ddf69a00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:14.274822 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59be277-fbff-4f88-a39e-4e14ddf69a00 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:14.288430 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 307/614] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 12:50:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:14.289291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59be277-fbff-4f88-a39e-4e14ddf69a00 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:14.307296 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c250ba34-a0fa-4bb6-90a6-46cb1c460574 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:14.344187 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f87f2-bd51-4176-8b7a-e2425917e377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:14.344809 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f87f2-bd51-4176-8b7a-e2425917e377 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:14.345097 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f87f2-bd51-4176-8b7a-e2425917e377 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:14.345372 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f87f2-bd51-4176-8b7a-e2425917e377 None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:14.346230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f87f2-bd51-4176-8b7a-e2425917e377 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:14.346539 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f87f2-bd51-4176-8b7a-e2425917e377 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:14.347922 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f87f2-bd51-4176-8b7a-e2425917e377 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:14.350245 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:14.359673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 308/615] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:14.360551 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f87f2-bd51-4176-8b7a-e2425917e377 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:14.404737 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59be277-fbff-4f88-a39e-4e14ddf69a00 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:14.466186 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a70ea5-b99a-409e-b20e-d6dd1be65a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:14.466844 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a70ea5-b99a-409e-b20e-d6dd1be65a8b None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:14.467129 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a70ea5-b99a-409e-b20e-d6dd1be65a8b None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:14.467412 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a70ea5-b99a-409e-b20e-d6dd1be65a8b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:14.476726 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f87f2-bd51-4176-8b7a-e2425917e377 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:14.496443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:14.512473 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f255fb-cdd6-4d3e-a679-65520829dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:14.515189 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f255fb-cdd6-4d3e-a679-65520829dc31 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:14.515189 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f255fb-cdd6-4d3e-a679-65520829dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:14.515189 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f255fb-cdd6-4d3e-a679-65520829dc31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:14.525913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f255fb-cdd6-4d3e-a679-65520829dc31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:14.527441 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f255fb-cdd6-4d3e-a679-65520829dc31 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:14.545406 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-57f255fb-cdd6-4d3e-a679-65520829dc31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:14.545406 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:14.545406 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:14.545406 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:14.545406 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:14.545406 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:14.545406 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:14.545406 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:14.545406 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:14.545406 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:14.545406 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:14.545406 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:14.545406 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:14.545406 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:14.545406 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:14.546884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:14.546884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:14.546884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:14.546884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:14.546884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:14.546884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:14.546884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:14.546884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:14.546884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:14.546884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:14.546884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:14.546884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:14.546884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:14.546884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:14.546884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:14.546884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:14.546884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:14.547779 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:14.547779 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:14.547779 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:14.547779 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:14.547779 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 309/616] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:14.548050 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f255fb-cdd6-4d3e-a679-65520829dc31 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:14.559092 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a70ea5-b99a-409e-b20e-d6dd1be65a8b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:14.560958 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a70ea5-b99a-409e-b20e-d6dd1be65a8b None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:14.599322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:14.652864 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f255fb-cdd6-4d3e-a679-65520829dc31 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:14.678680 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 308/617] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:50:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:50:14.679679 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a70ea5-b99a-409e-b20e-d6dd1be65a8b None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:14.691764 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b7b89-15c1-4af1-ab85-112532a2d723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:14.692561 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b7b89-15c1-4af1-ab85-112532a2d723 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:14.692884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b7b89-15c1-4af1-ab85-112532a2d723 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:14.693160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b7b89-15c1-4af1-ab85-112532a2d723 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:14.700933 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b7b89-15c1-4af1-ab85-112532a2d723 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:14.703027 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b7b89-15c1-4af1-ab85-112532a2d723 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:14.717647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-4f8b7b89-15c1-4af1-ab85-112532a2d723 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 12:50:14.717647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:14.717647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:14.717647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:14.717647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:14.717647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:14.717647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:14.717647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:14.717647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:14.717647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:14.717647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:14.717647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:14.717647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:50:14.717647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:50:14.717647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:50:14.717647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:50:14.719184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:14.719184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:14.719184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:50:14.719184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:14.719184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:50:14.719184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:14.719184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:14.719184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:14.719184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:14.719184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:14.719184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:14.719184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:14.719184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:14.719184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:14.719184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:14.719184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:14.719184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:14.719184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:14.720105 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:14.720105 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:14.720105 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:50:14.720105 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:50:14.720105 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:50:14.720105 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:50:14.720105 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:50:14.720105 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:50:14.720105 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 12:50:14.720105 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:14.720105 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 310/618] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:50:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:14.720732 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b7b89-15c1-4af1-ab85-112532a2d723 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:14.738152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:14.790069 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a70ea5-b99a-409e-b20e-d6dd1be65a8b None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:14.823943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b7b89-15c1-4af1-ab85-112532a2d723 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:14.826608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58aee78-3c5b-461f-a9bf-4feca5f21833 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:14.827342 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58aee78-3c5b-461f-a9bf-4feca5f21833 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:14.828157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58aee78-3c5b-461f-a9bf-4feca5f21833 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:14.828431 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58aee78-3c5b-461f-a9bf-4feca5f21833 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:14.829178 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58aee78-3c5b-461f-a9bf-4feca5f21833 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:14.829485 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58aee78-3c5b-461f-a9bf-4feca5f21833 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:14.830863 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58aee78-3c5b-461f-a9bf-4feca5f21833 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:14.834624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:14.842847 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 309/619] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:14.843748 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58aee78-3c5b-461f-a9bf-4feca5f21833 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:14.875391 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea7e09-ce76-4edd-864a-fb6f13974f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:14.875391 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea7e09-ce76-4edd-864a-fb6f13974f5a None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:14.875391 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea7e09-ce76-4edd-864a-fb6f13974f5a None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:14.875391 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea7e09-ce76-4edd-864a-fb6f13974f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:14.877387 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea7e09-ce76-4edd-864a-fb6f13974f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:14.878856 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea7e09-ce76-4edd-864a-fb6f13974f5a None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:14.897083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-1cea7e09-ce76-4edd-864a-fb6f13974f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:14.897083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:14.897083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:14.897083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:14.897083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:14.897083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:14.897083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:14.897083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:14.897083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:14.897083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:14.897083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:14.897083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:14.897083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:14.897083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:14.897083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:14.898169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:14.898169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:14.898169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:14.898169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:14.898169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:14.898169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:14.898169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:14.898169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:14.898169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:14.898169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:14.898169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:14.898169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:14.898169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:14.898169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:14.898169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:14.898169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:14.898169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:14.899158 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:14.899158 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:14.899158 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:14.899158 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:14.899158 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 311/620] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:14.899158 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea7e09-ce76-4edd-864a-fb6f13974f5a None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:14.954652 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58aee78-3c5b-461f-a9bf-4feca5f21833 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:14.965544 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:14.991645 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71404a-bb29-48c6-ae01-b614b41ba54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:14.992322 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71404a-bb29-48c6-ae01-b614b41ba54a None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:14.992605 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71404a-bb29-48c6-ae01-b614b41ba54a None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:14.992921 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e71404a-bb29-48c6-ae01-b614b41ba54a None admin] PATH_INFO: `/v3/users` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:14.993866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71404a-bb29-48c6-ae01-b614b41ba54a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:14.994078 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71404a-bb29-48c6-ae01-b614b41ba54a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:14.995480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e71404a-bb29-48c6-ae01-b614b41ba54a None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:15.008580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea7e09-ce76-4edd-864a-fb6f13974f5a None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:15.023473 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 310/621] 10.222.0.40 () {56 vars in 1137 bytes} [Thu Jul 14 12:50:14 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:15.023473 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71404a-bb29-48c6-ae01-b614b41ba54a None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:15.056308 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62572d2-f3a1-496e-a88d-90956c8a7004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:15.057152 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62572d2-f3a1-496e-a88d-90956c8a7004 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:15.057439 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62572d2-f3a1-496e-a88d-90956c8a7004 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:15.057710 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62572d2-f3a1-496e-a88d-90956c8a7004 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:15.066400 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62572d2-f3a1-496e-a88d-90956c8a7004 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:15.067955 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62572d2-f3a1-496e-a88d-90956c8a7004 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:15.083168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-d62572d2-f3a1-496e-a88d-90956c8a7004 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 12:50:15.083168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:15.083168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:15.083168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:15.083168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:15.083168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:15.083168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:15.083168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:15.083168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:15.083168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:15.083168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:15.083168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:15.083168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:50:15.083168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:50:15.083168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:50:15.083168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:50:15.084592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:15.084592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:15.084592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:50:15.084592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:15.084592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:50:15.084592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:15.084592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:15.084592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:15.084592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:15.084592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:15.084592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:15.084592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:15.084592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:15.084592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:15.084592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:15.084592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:15.084592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:15.084592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:15.085596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:15.085596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:15.085596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:50:15.085596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:50:15.085596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:50:15.085596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:50:15.085596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:50:15.085596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:50:15.085596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 14 12:50:15.085596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:15.085596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 312/622] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 12:50:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:15.086346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62572d2-f3a1-496e-a88d-90956c8a7004 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:15.108867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:15.141521 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e71404a-bb29-48c6-ae01-b614b41ba54a None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:15.180733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018c4db-d7cd-430e-8e19-93e5ba5c9401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:15.181426 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c4db-d7cd-430e-8e19-93e5ba5c9401 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:15.181714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c4db-d7cd-430e-8e19-93e5ba5c9401 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:15.181994 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6018c4db-d7cd-430e-8e19-93e5ba5c9401 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:15.182727 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018c4db-d7cd-430e-8e19-93e5ba5c9401 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:15.183034 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018c4db-d7cd-430e-8e19-93e5ba5c9401 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:15.184415 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6018c4db-d7cd-430e-8e19-93e5ba5c9401 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:15.196686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62572d2-f3a1-496e-a88d-90956c8a7004 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:15.196962 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 311/623] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:15.197871 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018c4db-d7cd-430e-8e19-93e5ba5c9401 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:15.229193 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:15.242011 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c100f9-bb82-4dd5-beb7-df4f86db94fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:15.242672 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c100f9-bb82-4dd5-beb7-df4f86db94fb None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:15.243973 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c100f9-bb82-4dd5-beb7-df4f86db94fb None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:15.243973 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c100f9-bb82-4dd5-beb7-df4f86db94fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:15.311108 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6018c4db-d7cd-430e-8e19-93e5ba5c9401 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:15.321174 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c100f9-bb82-4dd5-beb7-df4f86db94fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:15.322665 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c100f9-bb82-4dd5-beb7-df4f86db94fb None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:15.346491 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:15.353709 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f8bc3-66cc-470b-a1f7-d503f9db5aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:15.354311 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f8bc3-66cc-470b-a1f7-d503f9db5aee None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:15.354610 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f8bc3-66cc-470b-a1f7-d503f9db5aee None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:15.354849 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333f8bc3-66cc-470b-a1f7-d503f9db5aee None admin] PATH_INFO: `/v3/users` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:15.358596 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f8bc3-66cc-470b-a1f7-d503f9db5aee None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:15.358596 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f8bc3-66cc-470b-a1f7-d503f9db5aee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:15.358596 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333f8bc3-66cc-470b-a1f7-d503f9db5aee None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:15.376601 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 312/624] 10.222.0.40 () {56 vars in 1139 bytes} [Thu Jul 14 12:50:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:15.377346 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f8bc3-66cc-470b-a1f7-d503f9db5aee None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:15.440191 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 313/625] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:50:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:50:15.441398 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c100f9-bb82-4dd5-beb7-df4f86db94fb None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:15.484320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:15.503645 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333f8bc3-66cc-470b-a1f7-d503f9db5aee None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:15.548600 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797af108-199a-4b4a-bb28-1f0d414b8a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:15.549759 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797af108-199a-4b4a-bb28-1f0d414b8a5e None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:15.550049 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797af108-199a-4b4a-bb28-1f0d414b8a5e None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:15.550325 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797af108-199a-4b4a-bb28-1f0d414b8a5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:15.554835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c100f9-bb82-4dd5-beb7-df4f86db94fb None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:15.557980 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797af108-199a-4b4a-bb28-1f0d414b8a5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:15.558853 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797af108-199a-4b4a-bb28-1f0d414b8a5e None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:15.573454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-797af108-199a-4b4a-bb28-1f0d414b8a5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:15.573454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:15.573454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:15.573454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:15.573454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:15.573454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:15.573454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:15.573454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:15.573454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:15.573454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:15.573454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:15.573454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:15.573454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:50:15.573454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:50:15.573454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:50:15.574422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:50:15.574422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:15.574422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:15.574422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:15.574422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:15.574422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:15.574422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:15.574422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:15.574422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:15.574422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:15.574422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:15.574422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:15.574422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:15.574422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:15.574422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:15.574422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:15.574422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:15.575344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:50:15.575344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:50:15.575344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:50:15.575344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:50:15.575344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:50:15.575344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:50:15.575344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:15.575344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:15.575344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 313/626] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:15.577019 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797af108-199a-4b4a-bb28-1f0d414b8a5e None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:15.583094 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:15.599552 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f4ed3-963b-4a36-8dc9-d4380facccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:15.600206 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f4ed3-963b-4a36-8dc9-d4380facccc8 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:15.600494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f4ed3-963b-4a36-8dc9-d4380facccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:15.600809 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f4ed3-963b-4a36-8dc9-d4380facccc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:15.669797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f4ed3-963b-4a36-8dc9-d4380facccc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:15.671812 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f4ed3-963b-4a36-8dc9-d4380facccc8 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:15.681906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797af108-199a-4b4a-bb28-1f0d414b8a5e None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:15.716466 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75484f44-ed14-47a0-9c6f-353bbea67a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:15.717326 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75484f44-ed14-47a0-9c6f-353bbea67a5e None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:15.717612 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75484f44-ed14-47a0-9c6f-353bbea67a5e None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:15.717895 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75484f44-ed14-47a0-9c6f-353bbea67a5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:15.729023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75484f44-ed14-47a0-9c6f-353bbea67a5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:15.730475 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75484f44-ed14-47a0-9c6f-353bbea67a5e None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:15.737487 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:15.748401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-75484f44-ed14-47a0-9c6f-353bbea67a5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:15.748401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:15.748401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:15.748401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:15.748401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:15.748401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:15.748401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:15.748401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:15.748401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:15.748401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:15.748401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:15.748401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:15.748401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:15.748401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:15.748401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:15.749392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:15.749392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:15.749392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:15.749392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:15.749392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:15.749392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:15.749392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:15.749392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:15.749392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:15.749392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:15.749392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:15.749392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:15.749392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:15.749392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:15.749392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:15.749392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:15.749392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:15.750304 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:15.750304 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:15.750304 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:15.750304 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:15.750304 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 314/627] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:15.750592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75484f44-ed14-47a0-9c6f-353bbea67a5e None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:15.773769 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 314/628] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:50:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:50:15.775102 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab4f75-e8d7-4ed2-8393-e4adf5201fb3 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:15.775371 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab4f75-e8d7-4ed2-8393-e4adf5201fb3 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:15.775645 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab4f75-e8d7-4ed2-8393-e4adf5201fb3 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:15.778811 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 315/629] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:15.779625 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab4f75-e8d7-4ed2-8393-e4adf5201fb3 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:15.801962 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:15.857440 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75484f44-ed14-47a0-9c6f-353bbea67a5e None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:15.881969 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab4f75-e8d7-4ed2-8393-e4adf5201fb3 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:15.891448 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddafbaf-5bab-4a5d-9d0f-94804350bc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:15.892098 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddafbaf-5bab-4a5d-9d0f-94804350bc23 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:15.892378 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddafbaf-5bab-4a5d-9d0f-94804350bc23 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:15.892671 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddafbaf-5bab-4a5d-9d0f-94804350bc23 None admin] PATH_INFO: `/v3/projects` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:15.893457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddafbaf-5bab-4a5d-9d0f-94804350bc23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:15.893761 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddafbaf-5bab-4a5d-9d0f-94804350bc23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:15.895194 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddafbaf-5bab-4a5d-9d0f-94804350bc23 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:15.907694 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 315/630] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:50:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:15.908574 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddafbaf-5bab-4a5d-9d0f-94804350bc23 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:15.924454 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb56368-4b48-4881-8fff-603d4b0a47fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:15.925214 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb56368-4b48-4881-8fff-603d4b0a47fe None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:15.925527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb56368-4b48-4881-8fff-603d4b0a47fe None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:15.925806 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb56368-4b48-4881-8fff-603d4b0a47fe None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:15.926575 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb56368-4b48-4881-8fff-603d4b0a47fe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:15.926889 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb56368-4b48-4881-8fff-603d4b0a47fe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:15.928282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb56368-4b48-4881-8fff-603d4b0a47fe None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:15.939807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 316/631] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:15.941055 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62cde9-8206-48dd-be16-cd8fcf72ca77 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:15.941365 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62cde9-8206-48dd-be16-cd8fcf72ca77 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:15.941639 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a62cde9-8206-48dd-be16-cd8fcf72ca77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:15.958266 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-6a62cde9-8206-48dd-be16-cd8fcf72ca77 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:15.959739 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-6a62cde9-8206-48dd-be16-cd8fcf72ca77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:15.965505 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:16.015750 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddafbaf-5bab-4a5d-9d0f-94804350bc23 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:16.031849 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 317/632] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:50:16.032725 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62cde9-8206-48dd-be16-cd8fcf72ca77 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:16.047315 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:16.051017 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d821c-c8b2-4ff4-8ff8-ac2ecbd523ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:16.051800 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d821c-c8b2-4ff4-8ff8-ac2ecbd523ac None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:16.052087 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d821c-c8b2-4ff4-8ff8-ac2ecbd523ac None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:16.052343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9d821c-c8b2-4ff4-8ff8-ac2ecbd523ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:16.062863 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d821c-c8b2-4ff4-8ff8-ac2ecbd523ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:16.064323 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9d821c-c8b2-4ff4-8ff8-ac2ecbd523ac None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:16.082353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-cf9d821c-c8b2-4ff4-8ff8-ac2ecbd523ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:16.082353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:16.082353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:16.082353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:16.082353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:16.082353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:16.082353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:16.082353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:16.082353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:16.082353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:16.082353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:16.082353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:16.082353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:16.082353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:16.082353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:16.083457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:16.083457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:16.083457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:16.083457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:16.083457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:16.083457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:16.083457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:16.083457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:16.083457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:16.083457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:16.083457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:16.083457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:16.083457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:16.083457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:16.083457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:16.083457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:16.083457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:16.084794 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:16.084794 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:16.084794 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:16.084794 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:16.084794 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 316/633] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:16.084794 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d821c-c8b2-4ff4-8ff8-ac2ecbd523ac None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:16.144185 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a62cde9-8206-48dd-be16-cd8fcf72ca77 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:16.178425 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c3d81-7268-4211-b9d8-4f63337d0dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:16.179118 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c3d81-7268-4211-b9d8-4f63337d0dc1 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:16.179404 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c3d81-7268-4211-b9d8-4f63337d0dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:16.179695 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c3d81-7268-4211-b9d8-4f63337d0dc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:16.180509 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c3d81-7268-4211-b9d8-4f63337d0dc1 None admin] RBAC: Adding query filter params (role.id=f38b25010c404af5bbde51980f7e8dec, scope.project.id=2a58a74d443e40a782112277c58028b6, user.id=b8ba3c2afa1e4499bafda337dc4dc2a9) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:16.180854 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c3d81-7268-4211-b9d8-4f63337d0dc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:16.182301 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c3d81-7268-4211-b9d8-4f63337d0dc1 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:16.184536 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9d821c-c8b2-4ff4-8ff8-ac2ecbd523ac None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:16.187990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 318/634] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:50:16 2022] GET /identity/v3/role_assignments?user.id=b8ba3c2afa1e4499bafda337dc4dc2a9&scope.project.id=2a58a74d443e40a782112277c58028b6&role.id=f38b25010c404af5bbde51980f7e8dec => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:16.188807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c3d81-7268-4211-b9d8-4f63337d0dc1 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:16.195848 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:16.222417 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656bbc-890a-4a34-a14e-9367d7c0918e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:16.223233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656bbc-890a-4a34-a14e-9367d7c0918e None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:16.223515 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656bbc-890a-4a34-a14e-9367d7c0918e None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:16.223780 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57656bbc-890a-4a34-a14e-9367d7c0918e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:16.232054 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57656bbc-890a-4a34-a14e-9367d7c0918e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:16.233570 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57656bbc-890a-4a34-a14e-9367d7c0918e None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:16.248023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-57656bbc-890a-4a34-a14e-9367d7c0918e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:16.248023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:16.248023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:16.248023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:16.248023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:16.248023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:16.248023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:16.248023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:16.248023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:16.248023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:16.248023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:16.248023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:16.248023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:50:16.248023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:50:16.248023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:50:16.249044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:50:16.249044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:16.249044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:16.249044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:16.249044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:16.249044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:16.249044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:16.249044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:16.249044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:16.249044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:16.249044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:16.249044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:16.249044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:16.249044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:16.249044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:16.249044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:16.249044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:16.249970 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:50:16.249970 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:50:16.249970 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:50:16.249970 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:50:16.249970 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:50:16.249970 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:50:16.249970 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:16.249970 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:16.254361 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 317/635] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:16.255112 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656bbc-890a-4a34-a14e-9367d7c0918e None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:16.286038 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:16.315910 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c3d81-7268-4211-b9d8-4f63337d0dc1 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:16.366763 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57656bbc-890a-4a34-a14e-9367d7c0918e None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:16.368825 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4affdb-84d4-4e5b-847d-6bb9069a1017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:16.369628 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4affdb-84d4-4e5b-847d-6bb9069a1017 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:16.369907 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4affdb-84d4-4e5b-847d-6bb9069a1017 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:16.370181 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4affdb-84d4-4e5b-847d-6bb9069a1017 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:16.383612 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4affdb-84d4-4e5b-847d-6bb9069a1017 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:50:16.391935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-eb4affdb-84d4-4e5b-847d-6bb9069a1017 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:50:16.391935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:16.391935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:16.391935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:16.391935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:16.391935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:16.391935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:16.391935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:16.391935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:16.391935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:16.391935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:16.391935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:16.391935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:50:16.391935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:50:16.391935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:50:16.391935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:50:16.393098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:50:16.393098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:50:16.393098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:50:16.393098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:50:16.393098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:16.393098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:16.393098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:16.393098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:16.393098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:16.393098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:16.393098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:16.393098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:16.393098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:16.393098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:16.393098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:16.393098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:16.395051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:16.395051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:16.395051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:16.395051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:16.395051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:50:16.395051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:50:16.395051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:50:16.395051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:50:16.395051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:50:16.395051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:50:16.395051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:50:16.395051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:16.395051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 319/636] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 12:50:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:16.395051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4affdb-84d4-4e5b-847d-6bb9069a1017 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:16.413114 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1a479-a60a-4a4f-b6dc-87af2dc7fc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:16.413788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1a479-a60a-4a4f-b6dc-87af2dc7fc9b None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:16.414073 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1a479-a60a-4a4f-b6dc-87af2dc7fc9b None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:16.414350 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1a479-a60a-4a4f-b6dc-87af2dc7fc9b None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:16.415082 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1a479-a60a-4a4f-b6dc-87af2dc7fc9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:16.415393 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1a479-a60a-4a4f-b6dc-87af2dc7fc9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:16.417657 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1a479-a60a-4a4f-b6dc-87af2dc7fc9b None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:16.434561 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 318/637] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:16.434756 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1a479-a60a-4a4f-b6dc-87af2dc7fc9b None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:16.467199 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:16.507893 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4affdb-84d4-4e5b-847d-6bb9069a1017 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:16.542061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1a479-a60a-4a4f-b6dc-87af2dc7fc9b None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:16.544168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51394ef-0e5d-40d7-86e5-0c9194f77fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:16.544930 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51394ef-0e5d-40d7-86e5-0c9194f77fae None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:16.545292 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51394ef-0e5d-40d7-86e5-0c9194f77fae None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:16.545632 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51394ef-0e5d-40d7-86e5-0c9194f77fae None admin] PATH_INFO: `/v3/projects` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:16.546532 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51394ef-0e5d-40d7-86e5-0c9194f77fae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:16.546906 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51394ef-0e5d-40d7-86e5-0c9194f77fae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:16.548408 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51394ef-0e5d-40d7-86e5-0c9194f77fae None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:16.550172 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:16.561378 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 320/638] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:50:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:16.566796 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51394ef-0e5d-40d7-86e5-0c9194f77fae None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:16.583192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dcae4-05c6-41ed-b1d6-3767bd91a6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:16.583947 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dcae4-05c6-41ed-b1d6-3767bd91a6f2 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:16.584488 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dcae4-05c6-41ed-b1d6-3767bd91a6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:16.584813 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438dcae4-05c6-41ed-b1d6-3767bd91a6f2 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:16.585560 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dcae4-05c6-41ed-b1d6-3767bd91a6f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:16.585866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dcae4-05c6-41ed-b1d6-3767bd91a6f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:16.587245 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438dcae4-05c6-41ed-b1d6-3767bd91a6f2 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:16.600461 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 319/639] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:50:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:16.600461 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dcae4-05c6-41ed-b1d6-3767bd91a6f2 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:16.677314 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51394ef-0e5d-40d7-86e5-0c9194f77fae None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:16.695573 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:16.705501 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438dcae4-05c6-41ed-b1d6-3767bd91a6f2 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:16.714519 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f433b9-9a48-47f2-a590-32816caa2264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:16.715312 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f433b9-9a48-47f2-a590-32816caa2264 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:16.715605 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f433b9-9a48-47f2-a590-32816caa2264 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:16.715887 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f433b9-9a48-47f2-a590-32816caa2264 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:16.723784 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f433b9-9a48-47f2-a590-32816caa2264 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:16.725297 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f433b9-9a48-47f2-a590-32816caa2264 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:16.740671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-85f433b9-9a48-47f2-a590-32816caa2264 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:16.740671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:16.740671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:16.740671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:16.740671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:16.740671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:16.740671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:16.740671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:16.740671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:16.740671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:16.740671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:16.740671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:16.740671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:50:16.740671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:50:16.740671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:50:16.741797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:50:16.741797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:16.741797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:16.741797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:16.741797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:16.741797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:16.741797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:16.741797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:16.741797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:16.741797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:16.741797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:16.741797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:16.741797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:16.741797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:16.741797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:16.741797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:16.741797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:16.743855 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:50:16.743855 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:50:16.743855 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:50:16.743855 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:50:16.743855 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:50:16.743855 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:50:16.743855 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:16.743855 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:16.745376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844ee3c-a5b7-4c68-9229-73ddf1a7ef7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:16.746181 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844ee3c-a5b7-4c68-9229-73ddf1a7ef7e None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:16.746634 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844ee3c-a5b7-4c68-9229-73ddf1a7ef7e None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:16.746753 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 321/640] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:16.746987 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844ee3c-a5b7-4c68-9229-73ddf1a7ef7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:16.747568 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f433b9-9a48-47f2-a590-32816caa2264 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:16.747964 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844ee3c-a5b7-4c68-9229-73ddf1a7ef7e None admin] RBAC: Adding query filter params (role.id=f38b25010c404af5bbde51980f7e8dec, scope.project.id=2a58a74d443e40a782112277c58028b6, user.id=efbe88187dd84518818114165f60a5ef) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:16.748358 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844ee3c-a5b7-4c68-9229-73ddf1a7ef7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:16.749950 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844ee3c-a5b7-4c68-9229-73ddf1a7ef7e None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:16.764980 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 320/641] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:50:16 2022] GET /identity/v3/role_assignments?user.id=efbe88187dd84518818114165f60a5ef&scope.project.id=2a58a74d443e40a782112277c58028b6&role.id=f38b25010c404af5bbde51980f7e8dec => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:16.764980 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844ee3c-a5b7-4c68-9229-73ddf1a7ef7e None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:16.837245 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:16.895487 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844ee3c-a5b7-4c68-9229-73ddf1a7ef7e None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:16.895699 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f433b9-9a48-47f2-a590-32816caa2264 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:16.935009 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e64617-c364-4611-b3a2-22fd6348dd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:16.935918 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e64617-c364-4611-b3a2-22fd6348dd53 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:16.936282 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e64617-c364-4611-b3a2-22fd6348dd53 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:16.936654 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e64617-c364-4611-b3a2-22fd6348dd53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:16.939000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1469be2-a485-43be-879d-d3391d0ded2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:16.940004 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1469be2-a485-43be-879d-d3391d0ded2c None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:16.940474 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1469be2-a485-43be-879d-d3391d0ded2c None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:16.940955 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1469be2-a485-43be-879d-d3391d0ded2c None admin] PATH_INFO: `/v3/projects` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:16.941971 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1469be2-a485-43be-879d-d3391d0ded2c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:16.942482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1469be2-a485-43be-879d-d3391d0ded2c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:16.944168 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1469be2-a485-43be-879d-d3391d0ded2c None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:16.949775 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e64617-c364-4611-b3a2-22fd6348dd53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:16.951488 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e64617-c364-4611-b3a2-22fd6348dd53 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:16.961877 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 321/642] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:50:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:16.967734 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1469be2-a485-43be-879d-d3391d0ded2c None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:16.972072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-15e64617-c364-4611-b3a2-22fd6348dd53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:16.972072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:16.972072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:16.972072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:16.972072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:16.972072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:16.972072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:16.972072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:16.972072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:16.972072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:16.972072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:16.972072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:16.972072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:16.972072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:16.972072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:16.973047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:16.973047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:16.973047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:16.973047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:16.973047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:16.973047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:16.973047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:16.973047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:16.973047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:16.973047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:16.973047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:16.973047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:16.973047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:16.973047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:16.973047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:16.973047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:16.973047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:16.974291 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:16.974291 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:16.974291 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:16.974291 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:16.974291 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 322/643] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:16.980616 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e64617-c364-4611-b3a2-22fd6348dd53 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:16.994452 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:17.098631 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1469be2-a485-43be-879d-d3391d0ded2c None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:17.117685 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e64617-c364-4611-b3a2-22fd6348dd53 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:17.126228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:17.136936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cc628-5ec3-4f80-a3a0-f2e35cebc4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:17.137902 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cc628-5ec3-4f80-a3a0-f2e35cebc4f9 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:17.138398 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cc628-5ec3-4f80-a3a0-f2e35cebc4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:17.138881 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96cc628-5ec3-4f80-a3a0-f2e35cebc4f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:17.139987 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cc628-5ec3-4f80-a3a0-f2e35cebc4f9 None admin] RBAC: Adding query filter params (role.id=f38b25010c404af5bbde51980f7e8dec, scope.project.id=2a58a74d443e40a782112277c58028b6, user.id=513bc0a2d10240a5bc12cb402da41faf) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:17.140527 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cc628-5ec3-4f80-a3a0-f2e35cebc4f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:17.142226 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96cc628-5ec3-4f80-a3a0-f2e35cebc4f9 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:17.149233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 322/644] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:50:16 2022] GET /identity/v3/role_assignments?user.id=513bc0a2d10240a5bc12cb402da41faf&scope.project.id=2a58a74d443e40a782112277c58028b6&role.id=f38b25010c404af5bbde51980f7e8dec => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:17.173192 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac62baa-0143-47dc-baed-400d417ebddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:17.174350 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac62baa-0143-47dc-baed-400d417ebddf None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:17.174843 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac62baa-0143-47dc-baed-400d417ebddf None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:17.175329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac62baa-0143-47dc-baed-400d417ebddf None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:17.176307 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac62baa-0143-47dc-baed-400d417ebddf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:17.176870 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac62baa-0143-47dc-baed-400d417ebddf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:17.178554 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac62baa-0143-47dc-baed-400d417ebddf None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:17.193205 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 323/645] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:17.201794 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cc628-5ec3-4f80-a3a0-f2e35cebc4f9 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:17.305441 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:17.329396 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96cc628-5ec3-4f80-a3a0-f2e35cebc4f9 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:17.365627 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f707995-1e3c-4dad-8e86-2951d5dce19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:17.366342 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f707995-1e3c-4dad-8e86-2951d5dce19c None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:17.366627 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f707995-1e3c-4dad-8e86-2951d5dce19c None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:17.366903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f707995-1e3c-4dad-8e86-2951d5dce19c None admin] PATH_INFO: `/v3/users/nova` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:17.375341 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f707995-1e3c-4dad-8e86-2951d5dce19c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:17.376850 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f707995-1e3c-4dad-8e86-2951d5dce19c None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:17.391781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-1f707995-1e3c-4dad-8e86-2951d5dce19c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 12:50:17.391781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:17.391781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:17.391781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:17.391781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:17.391781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:17.391781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:17.391781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:17.391781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:17.391781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:17.391781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:17.391781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:17.391781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:50:17.391781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:50:17.391781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:50:17.391781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:50:17.392928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:17.392928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:17.392928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:50:17.392928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:17.392928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:50:17.392928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:17.392928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:17.392928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:17.392928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:17.392928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:17.392928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:17.392928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:17.392928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:17.392928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:17.392928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:17.392928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:17.392928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:17.392928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:17.393975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:17.393975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:17.393975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:50:17.393975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:50:17.393975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:50:17.393975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:50:17.393975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:50:17.393975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:50:17.393975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 12:50:17.393975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:17.393975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 323/646] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 14 12:50:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:17.398694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac62baa-0143-47dc-baed-400d417ebddf None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:17.515031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac62baa-0143-47dc-baed-400d417ebddf None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:17.550746 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad18f2-e9a8-44d6-a17a-5e1ebf5eca5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:17.551418 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad18f2-e9a8-44d6-a17a-5e1ebf5eca5f None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:17.551704 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad18f2-e9a8-44d6-a17a-5e1ebf5eca5f None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:17.551981 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad18f2-e9a8-44d6-a17a-5e1ebf5eca5f None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:17.552837 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad18f2-e9a8-44d6-a17a-5e1ebf5eca5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:17.553153 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad18f2-e9a8-44d6-a17a-5e1ebf5eca5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:17.554601 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad18f2-e9a8-44d6-a17a-5e1ebf5eca5f None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:17.573217 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 324/647] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 14 12:50:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:50:17.579714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f707995-1e3c-4dad-8e86-2951d5dce19c None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:17.691766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f707995-1e3c-4dad-8e86-2951d5dce19c None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:17.727411 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb2050-8eaf-4ec7-87ff-7f84083662ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:17.728064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb2050-8eaf-4ec7-87ff-7f84083662ac None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:17.728340 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb2050-8eaf-4ec7-87ff-7f84083662ac None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:17.728615 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cb2050-8eaf-4ec7-87ff-7f84083662ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:17.748621 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:17.798616 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb2050-8eaf-4ec7-87ff-7f84083662ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:17.800087 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18cb2050-8eaf-4ec7-87ff-7f84083662ac None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:17.902012 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 324/648] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:50:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 14 12:50:17.908995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad18f2-e9a8-44d6-a17a-5e1ebf5eca5f None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:17.938139 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:18.015087 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad18f2-e9a8-44d6-a17a-5e1ebf5eca5f None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:18.054496 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f68941-b606-4c5d-9cdf-0ca39c667c6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:18.055297 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f68941-b606-4c5d-9cdf-0ca39c667c6c None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:18.055636 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f68941-b606-4c5d-9cdf-0ca39c667c6c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:18.055919 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f68941-b606-4c5d-9cdf-0ca39c667c6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:18.067348 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f68941-b606-4c5d-9cdf-0ca39c667c6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:18.068856 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f68941-b606-4c5d-9cdf-0ca39c667c6c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:18.087429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-47f68941-b606-4c5d-9cdf-0ca39c667c6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:18.087429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:18.087429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:18.087429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:18.087429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:18.087429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:18.087429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:18.087429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:18.087429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:18.087429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:18.087429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:18.087429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:18.087429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:18.087429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:18.087429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:18.088414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:18.088414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:18.088414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:18.088414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:18.088414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:18.088414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:18.088414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:18.088414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:18.088414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:18.088414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:18.088414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:18.088414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:18.088414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:18.088414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:18.088414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:18.088414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:18.088414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:18.089346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:18.089346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:18.089346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:18.089346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:18.089346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 325/649] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:18.095197 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb2050-8eaf-4ec7-87ff-7f84083662ac None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:18.140960 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:18.203049 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cb2050-8eaf-4ec7-87ff-7f84083662ac None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:18.238321 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bb390-091b-4f09-874e-ca41fcb0adfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:18.238983 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bb390-091b-4f09-874e-ca41fcb0adfa None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:18.239261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bb390-091b-4f09-874e-ca41fcb0adfa None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:18.239530 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bb390-091b-4f09-874e-ca41fcb0adfa None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:18.240249 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bb390-091b-4f09-874e-ca41fcb0adfa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:18.240553 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bb390-091b-4f09-874e-ca41fcb0adfa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:18.241941 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bb390-091b-4f09-874e-ca41fcb0adfa None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:18.254433 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 325/650] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:18.259833 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f68941-b606-4c5d-9cdf-0ca39c667c6c None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:18.345932 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:18.369469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f68941-b606-4c5d-9cdf-0ca39c667c6c None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:18.410620 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9065fe-cd6d-47f9-890e-2379cb48f650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:18.411433 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9065fe-cd6d-47f9-890e-2379cb48f650 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:18.411718 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9065fe-cd6d-47f9-890e-2379cb48f650 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:18.412000 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9065fe-cd6d-47f9-890e-2379cb48f650 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:18.419921 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9065fe-cd6d-47f9-890e-2379cb48f650 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:18.421977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9065fe-cd6d-47f9-890e-2379cb48f650 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:18.435915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-8b9065fe-cd6d-47f9-890e-2379cb48f650 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:18.435915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:18.435915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:18.435915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:18.435915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:18.435915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:18.435915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:18.435915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:18.435915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:18.435915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:18.435915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:18.435915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:18.435915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:50:18.435915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:50:18.435915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:50:18.437475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:50:18.437475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:18.437475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:18.437475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:18.437475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:18.437475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:18.437475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:18.437475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:18.437475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:18.437475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:18.437475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:18.437475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:18.437475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:18.437475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:18.437475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:18.437475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:18.437475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:18.438381 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:50:18.438381 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:50:18.438381 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:50:18.438381 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:50:18.438381 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:50:18.438381 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:50:18.438381 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:18.438381 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:18.438381 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 326/651] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:18.445045 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bb390-091b-4f09-874e-ca41fcb0adfa None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:18.549834 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:18.550222 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a0753-3f12-45d9-bc58-ec25c8febe44 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:18.550475 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a0753-3f12-45d9-bc58-ec25c8febe44 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:18.550762 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a0753-3f12-45d9-bc58-ec25c8febe44 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:18.552412 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 327/652] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:18.553100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bb390-091b-4f09-874e-ca41fcb0adfa None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:18.558012 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd4781-a521-47a6-a27b-11bec8b43ad1 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:18.558296 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd4781-a521-47a6-a27b-11bec8b43ad1 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:18.558574 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bd4781-a521-47a6-a27b-11bec8b43ad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:18.581593 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-66bd4781-a521-47a6-a27b-11bec8b43ad1 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:18.583847 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-66bd4781-a521-47a6-a27b-11bec8b43ad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:18.587843 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d3468-07af-419d-93dc-d4621adce05e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:18.588504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d3468-07af-419d-93dc-d4621adce05e None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:18.588848 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d3468-07af-419d-93dc-d4621adce05e None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:18.589127 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205d3468-07af-419d-93dc-d4621adce05e None admin] PATH_INFO: `/v3/projects` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:18.589929 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d3468-07af-419d-93dc-d4621adce05e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:18.590240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d3468-07af-419d-93dc-d4621adce05e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:18.591688 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205d3468-07af-419d-93dc-d4621adce05e None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:18.606497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 326/653] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:50:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:18.612592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d3468-07af-419d-93dc-d4621adce05e None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:18.688968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 328/654] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:50:18.712598 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd4781-a521-47a6-a27b-11bec8b43ad1 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:18.733600 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205d3468-07af-419d-93dc-d4621adce05e None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:18.773089 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176f328-cfde-45e2-aa7e-c01f52445eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:18.774159 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176f328-cfde-45e2-aa7e-c01f52445eff None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:18.774658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176f328-cfde-45e2-aa7e-c01f52445eff None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:18.775105 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176f328-cfde-45e2-aa7e-c01f52445eff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:18.776204 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176f328-cfde-45e2-aa7e-c01f52445eff None admin] RBAC: Adding query filter params (role.id=9bca71f77ac24a898d3445ab3c205809, scope.project.id=2a58a74d443e40a782112277c58028b6, user.id=1faa19de04744a4084a9c60c4af64f3e) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:18.776839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176f328-cfde-45e2-aa7e-c01f52445eff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:18.778898 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9176f328-cfde-45e2-aa7e-c01f52445eff None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:18.786290 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 327/655] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:50:18 2022] GET /identity/v3/role_assignments?user.id=1faa19de04744a4084a9c60c4af64f3e&scope.project.id=2a58a74d443e40a782112277c58028b6&role.id=9bca71f77ac24a898d3445ab3c205809 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:18.802272 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:18.840529 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bd4781-a521-47a6-a27b-11bec8b43ad1 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:18.882200 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439d7b6-38de-4892-80fa-048e22fbd102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:18.883388 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439d7b6-38de-4892-80fa-048e22fbd102 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:18.883877 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439d7b6-38de-4892-80fa-048e22fbd102 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:18.884362 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e439d7b6-38de-4892-80fa-048e22fbd102 None admin] PATH_INFO: `/v3/services/image` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:18.885304 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439d7b6-38de-4892-80fa-048e22fbd102 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:18.887056 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e439d7b6-38de-4892-80fa-048e22fbd102 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:18.902123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-e439d7b6-38de-4892-80fa-048e22fbd102 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 12:50:18.902123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:18.902123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:50:18.902123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:50:18.902123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:50:18.902123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:50:18.902123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:50:18.902123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:18.902123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 12:50:18.902123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:18.902123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:18.902123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:18.902123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:18.902123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:18.902123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:18.902123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:18.902123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:18.903326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:18.903326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:18.903326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:18.903326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:18.903326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:18.903326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:18.903326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:50:18.903326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:50:18.903326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:50:18.903326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:50:18.903326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:18.903326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:18.903326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:18.903326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:18.903326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:18.903326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:18.904230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:18.904230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:18.904230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:18.904230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:18.904230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:18.904230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:18.904230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:18.904230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:18.904230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:18.904230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:18.904230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:50:18.904230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:18.904230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 12:50:18.904230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:18.907901 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 329/656] 10.222.0.40 () {56 vars in 1105 bytes} [Thu Jul 14 12:50:18 2022] GET /identity/v3/services/image => generated 86 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:50:18.914194 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176f328-cfde-45e2-aa7e-c01f52445eff None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:18.943343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:19.027037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176f328-cfde-45e2-aa7e-c01f52445eff None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:19.063526 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce64b5-bc57-40b0-ab6d-e671b12a0813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:19.064189 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce64b5-bc57-40b0-ab6d-e671b12a0813 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:19.064472 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce64b5-bc57-40b0-ab6d-e671b12a0813 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:19.064788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce64b5-bc57-40b0-ab6d-e671b12a0813 None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:19.065496 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce64b5-bc57-40b0-ab6d-e671b12a0813 None admin] RBAC: Adding query filter params (name=image) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:19.065795 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce64b5-bc57-40b0-ab6d-e671b12a0813 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:19.067165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce64b5-bc57-40b0-ab6d-e671b12a0813 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:19.072548 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 328/657] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:19.078532 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439d7b6-38de-4892-80fa-048e22fbd102 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:19.188943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e439d7b6-38de-4892-80fa-048e22fbd102 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:19.225309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb917e-39ca-41f7-964c-2a8ddeac78e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:19.225987 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb917e-39ca-41f7-964c-2a8ddeac78e3 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:19.226267 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb917e-39ca-41f7-964c-2a8ddeac78e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:19.226544 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb917e-39ca-41f7-964c-2a8ddeac78e3 None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:19.227262 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb917e-39ca-41f7-964c-2a8ddeac78e3 None admin] RBAC: Adding query filter params (type=image) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:19.227570 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb917e-39ca-41f7-964c-2a8ddeac78e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:19.228999 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb917e-39ca-41f7-964c-2a8ddeac78e3 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:19.233072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:19.236473 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 330/658] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:50:19.320071 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0dbf5-4168-4f90-86ea-eec58f433acd None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:19.320355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0dbf5-4168-4f90-86ea-eec58f433acd None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:19.320707 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf0dbf5-4168-4f90-86ea-eec58f433acd None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:19.322238 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 329/659] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:19.328629 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b4557-19d0-4b34-b1e7-291a4dfad90d None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:19.329078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b4557-19d0-4b34-b1e7-291a4dfad90d None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:19.329458 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633b4557-19d0-4b34-b1e7-291a4dfad90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:19.348515 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-633b4557-19d0-4b34-b1e7-291a4dfad90d None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:19.349902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-633b4557-19d0-4b34-b1e7-291a4dfad90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:19.426970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 331/660] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:50:19.451715 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0dbf5-4168-4f90-86ea-eec58f433acd None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:19.557012 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:19.565355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf0dbf5-4168-4f90-86ea-eec58f433acd None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:19.602108 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b24ccb-603a-4e4c-996b-11540aee49ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:19.603089 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b24ccb-603a-4e4c-996b-11540aee49ca None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:19.603468 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b24ccb-603a-4e4c-996b-11540aee49ca None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:19.603845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b24ccb-603a-4e4c-996b-11540aee49ca None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:19.604591 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b24ccb-603a-4e4c-996b-11540aee49ca None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:19.606069 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b24ccb-603a-4e4c-996b-11540aee49ca None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:19.621721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-53b24ccb-603a-4e4c-996b-11540aee49ca None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 12:50:19.621721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:19.621721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:50:19.621721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:50:19.621721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:50:19.621721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:50:19.621721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:50:19.621721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:19.621721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 12:50:19.621721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:19.621721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:19.621721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:19.621721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:19.621721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:19.621721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:19.621721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:19.622914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:19.622914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:19.622914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:19.622914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:19.622914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:19.622914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:19.622914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:19.622914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:50:19.622914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:50:19.622914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:50:19.622914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:50:19.622914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:19.622914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:19.622914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:19.622914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:19.622914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:19.623982 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:19.623982 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:19.623982 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:19.623982 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:19.623982 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:19.623982 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:19.623982 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:19.623982 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:19.623982 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:19.623982 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:19.623982 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:19.623982 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:50:19.623982 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:19.623982 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 12:50:19.623982 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:19.629879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 330/661] 10.222.0.40 () {56 vars in 1129 bytes} [Thu Jul 14 12:50:19 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:19.631662 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b4557-19d0-4b34-b1e7-291a4dfad90d None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:19.700081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316382e-64cf-4345-9ef2-aa3f8c8acc5b None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:19.700448 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316382e-64cf-4345-9ef2-aa3f8c8acc5b None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:19.700658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316382e-64cf-4345-9ef2-aa3f8c8acc5b None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:19.703522 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 331/662] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:50:19.707735 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482719f6-83d0-41a0-a790-398343566a3f None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:19.708048 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482719f6-83d0-41a0-a790-398343566a3f None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:19.708295 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482719f6-83d0-41a0-a790-398343566a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:19.726197 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-482719f6-83d0-41a0-a790-398343566a3f None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:19.727391 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-482719f6-83d0-41a0-a790-398343566a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:19.746064 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633b4557-19d0-4b34-b1e7-291a4dfad90d None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:19.777813 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:19.785064 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac2b53-1100-457f-89c6-b8f2f7347146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:19.792680 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac2b53-1100-457f-89c6-b8f2f7347146 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:19.792680 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac2b53-1100-457f-89c6-b8f2f7347146 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:19.792680 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac2b53-1100-457f-89c6-b8f2f7347146 None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:19.792680 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac2b53-1100-457f-89c6-b8f2f7347146 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:19.792680 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac2b53-1100-457f-89c6-b8f2f7347146 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:19.792680 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac2b53-1100-457f-89c6-b8f2f7347146 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:19.798807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 332/663] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jul 14 12:50:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:19.799878 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac2b53-1100-457f-89c6-b8f2f7347146 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:19.819201 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 332/664] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:50:19.842397 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482719f6-83d0-41a0-a790-398343566a3f None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:19.910141 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac2b53-1100-457f-89c6-b8f2f7347146 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:19.937537 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:19.950476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c4862-1338-45c5-9e43-fc388f20993d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:19.951592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c4862-1338-45c5-9e43-fc388f20993d None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:19.953155 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c4862-1338-45c5-9e43-fc388f20993d None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:19.953372 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983c4862-1338-45c5-9e43-fc388f20993d None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:19.954516 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c4862-1338-45c5-9e43-fc388f20993d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:19.954771 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c4862-1338-45c5-9e43-fc388f20993d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:19.956810 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983c4862-1338-45c5-9e43-fc388f20993d None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:19.959710 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482719f6-83d0-41a0-a790-398343566a3f None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:19.963445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 333/665] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jul 14 12:50:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:20.005007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166d4c9-3874-4993-81c7-ea4233ca5ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:20.005905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166d4c9-3874-4993-81c7-ea4233ca5ba1 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:20.006187 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166d4c9-3874-4993-81c7-ea4233ca5ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:20.006463 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f166d4c9-3874-4993-81c7-ea4233ca5ba1 None admin] PATH_INFO: `/v3/services/network` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:20.007261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166d4c9-3874-4993-81c7-ea4233ca5ba1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:20.008829 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f166d4c9-3874-4993-81c7-ea4233ca5ba1 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:20.022407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-f166d4c9-3874-4993-81c7-ea4233ca5ba1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 12:50:20.022407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:20.022407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:50:20.022407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:50:20.022407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:50:20.022407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:50:20.022407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:50:20.022407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:20.022407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 12:50:20.022407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:20.022407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:20.022407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:20.022407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:20.022407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:20.022407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:20.022407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:20.022407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:20.023504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:20.023504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:20.023504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:20.023504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:20.023504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:20.023504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:20.023504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:50:20.023504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:50:20.023504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:50:20.023504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:50:20.023504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:20.023504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:20.023504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:20.023504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:20.023504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:20.023504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:20.024344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:20.024344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:20.024344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:20.024344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:20.024344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:20.024344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:20.024344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:20.024344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:20.024344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:20.024344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:20.024344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:50:20.024344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:20.024344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 12:50:20.024344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:20.028727 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 333/666] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:19 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:50:20.030217 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c4862-1338-45c5-9e43-fc388f20993d None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:20.091716 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:20.148100 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983c4862-1338-45c5-9e43-fc388f20993d None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:20.181319 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740e6524-9234-4b3e-babc-6019e4d7a7f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:20.181988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e6524-9234-4b3e-babc-6019e4d7a7f4 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:20.182272 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e6524-9234-4b3e-babc-6019e4d7a7f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:20.182546 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740e6524-9234-4b3e-babc-6019e4d7a7f4 None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:20.183258 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e6524-9234-4b3e-babc-6019e4d7a7f4 None admin] RBAC: Adding query filter params (name=network) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:20.183563 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e6524-9234-4b3e-babc-6019e4d7a7f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:20.185055 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740e6524-9234-4b3e-babc-6019e4d7a7f4 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:20.192725 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 334/667] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 12:50:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:20.195391 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166d4c9-3874-4993-81c7-ea4233ca5ba1 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:20.304096 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f166d4c9-3874-4993-81c7-ea4233ca5ba1 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:20.340043 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba29650-727b-4a5d-b169-edb774c20690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:20.340739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba29650-727b-4a5d-b169-edb774c20690 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:20.341028 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba29650-727b-4a5d-b169-edb774c20690 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:20.341308 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba29650-727b-4a5d-b169-edb774c20690 None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:20.342015 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba29650-727b-4a5d-b169-edb774c20690 None admin] RBAC: Adding query filter params (type=network) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:20.342322 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba29650-727b-4a5d-b169-edb774c20690 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:20.343771 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba29650-727b-4a5d-b169-edb774c20690 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:20.349880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 334/668] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 12:50:20 2022] GET /identity/v3/services?type=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:21.215185 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3c3fc-21d2-4b6e-ab11-f33b4106bad9 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:21.215185 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3c3fc-21d2-4b6e-ab11-f33b4106bad9 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:21.215185 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a3c3fc-21d2-4b6e-ab11-f33b4106bad9 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:21.216244 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 335/669] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:21.222403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e914be8-d956-48b9-9b96-24d433c9939e None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:21.223267 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e914be8-d956-48b9-9b96-24d433c9939e None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:21.223744 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e914be8-d956-48b9-9b96-24d433c9939e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:21.240996 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-2e914be8-d956-48b9-9b96-24d433c9939e None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:21.242498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-2e914be8-d956-48b9-9b96-24d433c9939e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:21.245662 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:21.322496 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 335/670] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 14 12:50:21.346368 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3c3fc-21d2-4b6e-ab11-f33b4106bad9 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:21.460795 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a3c3fc-21d2-4b6e-ab11-f33b4106bad9 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:21.481288 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:21.500373 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652261a2-95f5-496a-b4c0-2e07579c6a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:21.501293 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652261a2-95f5-496a-b4c0-2e07579c6a2a None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:21.501586 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652261a2-95f5-496a-b4c0-2e07579c6a2a None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:21.501866 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652261a2-95f5-496a-b4c0-2e07579c6a2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:21.512970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652261a2-95f5-496a-b4c0-2e07579c6a2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:50:21.521284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-652261a2-95f5-496a-b4c0-2e07579c6a2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:50:21.521284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:21.521284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:21.521284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:21.521284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:21.521284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:21.521284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:21.521284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:21.521284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:21.521284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:21.521284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:21.521284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:21.521284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:50:21.521284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:50:21.521284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:50:21.521284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:50:21.522240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:50:21.522240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:50:21.522240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:50:21.522240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:50:21.522240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:21.522240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:21.522240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:21.522240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:21.522240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:21.522240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:21.522240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:21.522240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:21.522240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:21.522240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:21.522240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:21.522240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:21.523339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:21.523339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:21.523339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:21.523339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:21.523339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:50:21.523339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:50:21.523339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:50:21.523339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:50:21.523339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:50:21.523339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:50:21.523339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:50:21.523339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:21.523339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 336/671] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 12:50:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:21.528487 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e914be8-d956-48b9-9b96-24d433c9939e None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:21.599752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf7cb3-fcea-4ccc-a239-4213a80e43dd None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:21.600082 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf7cb3-fcea-4ccc-a239-4213a80e43dd None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:21.600316 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaf7cb3-fcea-4ccc-a239-4213a80e43dd None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:21.601988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 337/672] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:21.607291 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbfb66-bc6e-4e1b-9e96-55a5e1285a6c None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:21.607582 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbfb66-bc6e-4e1b-9e96-55a5e1285a6c None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:21.607870 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbfb66-bc6e-4e1b-9e96-55a5e1285a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:21.626089 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-a5cbfb66-bc6e-4e1b-9e96-55a5e1285a6c None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:21.627295 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-a5cbfb66-bc6e-4e1b-9e96-55a5e1285a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:21.646777 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e914be8-d956-48b9-9b96-24d433c9939e None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:21.689665 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc9735-1919-4ebe-8563-c2dc9996ccfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:21.690727 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc9735-1919-4ebe-8563-c2dc9996ccfd None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:21.691081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc9735-1919-4ebe-8563-c2dc9996ccfd None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:21.691438 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc9735-1919-4ebe-8563-c2dc9996ccfd None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:21.692264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc9735-1919-4ebe-8563-c2dc9996ccfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:21.692665 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc9735-1919-4ebe-8563-c2dc9996ccfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:21.694859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc9735-1919-4ebe-8563-c2dc9996ccfd None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:21.706317 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 336/673] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:50:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:21.711702 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc9735-1919-4ebe-8563-c2dc9996ccfd None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:21.714472 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:21.715420 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 338/674] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:50:21.734817 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbfb66-bc6e-4e1b-9e96-55a5e1285a6c None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:21.841862 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc9735-1919-4ebe-8563-c2dc9996ccfd None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:21.860233 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbfb66-bc6e-4e1b-9e96-55a5e1285a6c None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:21.869054 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:21.881719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23416f43-f06b-47e9-84e3-da2a4e141c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:21.882733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23416f43-f06b-47e9-84e3-da2a4e141c1e None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:21.883196 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23416f43-f06b-47e9-84e3-da2a4e141c1e None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:21.883625 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23416f43-f06b-47e9-84e3-da2a4e141c1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:21.896662 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23416f43-f06b-47e9-84e3-da2a4e141c1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:21.899264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23416f43-f06b-47e9-84e3-da2a4e141c1e None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:21.899957 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451145fd-b797-42c8-8f71-485c3a08d167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:21.900843 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451145fd-b797-42c8-8f71-485c3a08d167 None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:21.901247 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451145fd-b797-42c8-8f71-485c3a08d167 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:21.901628 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451145fd-b797-42c8-8f71-485c3a08d167 None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:21.902579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451145fd-b797-42c8-8f71-485c3a08d167 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:21.904207 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451145fd-b797-42c8-8f71-485c3a08d167 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:21.920578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-23416f43-f06b-47e9-84e3-da2a4e141c1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:21.920578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:21.920578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:21.920578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:21.920578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:21.920578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:21.920578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:21.920578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:21.920578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:21.920578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:21.920578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:21.920578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:21.920578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:21.920578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:21.920578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:21.921703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:21.921703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:21.921703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:21.921703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:21.921703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:21.921703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:21.921703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:21.921703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:21.921703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:21.921703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:21.921703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:21.921703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:21.921703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:21.921703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:21.921703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:21.921703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:21.921703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:21.922613 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:21.922613 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:21.922613 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:21.922613 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:21.924567 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 337/675] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:21.930028 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23416f43-f06b-47e9-84e3-da2a4e141c1e None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:21.989226 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:22.017128 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 339/676] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 12:50:21 2022] POST /identity/v3/services => generated 242 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:50:22.039131 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23416f43-f06b-47e9-84e3-da2a4e141c1e None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:22.097042 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c0ba9a-f224-4f2c-826c-ca2873b23f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:22.097725 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0ba9a-f224-4f2c-826c-ca2873b23f6d None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:22.098010 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0ba9a-f224-4f2c-826c-ca2873b23f6d None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:22.098287 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c0ba9a-f224-4f2c-826c-ca2873b23f6d None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:22.099025 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0ba9a-f224-4f2c-826c-ca2873b23f6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:22.099331 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0ba9a-f224-4f2c-826c-ca2873b23f6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:22.100772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c0ba9a-f224-4f2c-826c-ca2873b23f6d None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:22.115163 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 338/677] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:22.120934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451145fd-b797-42c8-8f71-485c3a08d167 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:22.269178 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451145fd-b797-42c8-8f71-485c3a08d167 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:22.307498 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b56dd-ad80-4bf6-80f1-16499cdaa4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:22.308314 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b56dd-ad80-4bf6-80f1-16499cdaa4c2 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:22.308599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b56dd-ad80-4bf6-80f1-16499cdaa4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:22.308910 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05b56dd-ad80-4bf6-80f1-16499cdaa4c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:22.319396 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b56dd-ad80-4bf6-80f1-16499cdaa4c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:22.319879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12698ffe-0c37-44d0-80f5-a8eb7cd29d22 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:22.320373 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12698ffe-0c37-44d0-80f5-a8eb7cd29d22 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:22.320373 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12698ffe-0c37-44d0-80f5-a8eb7cd29d22 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:22.321053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05b56dd-ad80-4bf6-80f1-16499cdaa4c2 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:22.322081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 339/678] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:50:22.327382 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f600b01-90fa-47d7-aff8-7da66cc16be0 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:22.327706 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f600b01-90fa-47d7-aff8-7da66cc16be0 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:22.327989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f600b01-90fa-47d7-aff8-7da66cc16be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:22.341820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-e05b56dd-ad80-4bf6-80f1-16499cdaa4c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 12:50:22.341820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:22.341820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:22.341820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:22.341820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:22.341820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:22.341820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:22.341820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:22.341820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:22.341820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:22.341820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:22.341820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:22.341820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:50:22.341820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:50:22.341820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:50:22.341820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:50:22.345257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:22.345257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:22.345257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:50:22.345257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:22.345257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:50:22.345257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:22.345257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:22.345257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:22.345257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:22.345257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:22.345257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:22.345257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:22.345257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:22.345257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:22.345257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:22.345257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:22.345257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:22.345257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:22.346429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:22.346429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:22.346429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:50:22.346429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:50:22.346429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:50:22.346429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:50:22.346429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:50:22.346429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:50:22.346429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 12:50:22.346429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:22.346429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 340/679] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 14 12:50:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:22.348731 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b56dd-ad80-4bf6-80f1-16499cdaa4c2 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:22.348989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-7f600b01-90fa-47d7-aff8-7da66cc16be0 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:22.350384 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-7f600b01-90fa-47d7-aff8-7da66cc16be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:22.383057 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:22.428740 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 340/680] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:22 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:50:22.450959 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f600b01-90fa-47d7-aff8-7da66cc16be0 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:22.470166 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05b56dd-ad80-4bf6-80f1-16499cdaa4c2 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:22.502455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:22.520847 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ffa06-b03d-42f8-b1cc-cf83a5431730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:22.522159 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ffa06-b03d-42f8-b1cc-cf83a5431730 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:22.523160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ffa06-b03d-42f8-b1cc-cf83a5431730 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:22.523966 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ffa06-b03d-42f8-b1cc-cf83a5431730 None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:22.525303 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ffa06-b03d-42f8-b1cc-cf83a5431730 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:22.526327 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ffa06-b03d-42f8-b1cc-cf83a5431730 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:22.528474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386ffa06-b03d-42f8-b1cc-cf83a5431730 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:22.556329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 341/681] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 14 12:50:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:50:22.563795 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ffa06-b03d-42f8-b1cc-cf83a5431730 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:22.579820 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f600b01-90fa-47d7-aff8-7da66cc16be0 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:22.620016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9759165e-5b2c-4174-9962-68c81b037cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:22.620519 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759165e-5b2c-4174-9962-68c81b037cd8 None admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:22.620836 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759165e-5b2c-4174-9962-68c81b037cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:22.621115 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9759165e-5b2c-4174-9962-68c81b037cd8 None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:22.621845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759165e-5b2c-4174-9962-68c81b037cd8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:22.623496 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9759165e-5b2c-4174-9962-68c81b037cd8 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:22.670202 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:22.688248 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ffa06-b03d-42f8-b1cc-cf83a5431730 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:22.724682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 341/682] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 12:50:22 2022] POST /identity/v3/services => generated 251 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:50:22.724682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308a22f-73a9-405b-a404-537fd5b58b30 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:22.724682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308a22f-73a9-405b-a404-537fd5b58b30 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:22.724682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d308a22f-73a9-405b-a404-537fd5b58b30 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:22.724682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 342/683] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:22.728794 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217dbe4-59f9-4dd8-ae55-bed48ec2550b None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:22.729147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217dbe4-59f9-4dd8-ae55-bed48ec2550b None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:22.729431 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c217dbe4-59f9-4dd8-ae55-bed48ec2550b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:22.741767 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e273f-e742-4f00-99a1-6b1ee353f9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:22.743035 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e273f-e742-4f00-99a1-6b1ee353f9fe None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:22.743574 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e273f-e742-4f00-99a1-6b1ee353f9fe None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:22.744065 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855e273f-e742-4f00-99a1-6b1ee353f9fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:22.752925 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-c217dbe4-59f9-4dd8-ae55-bed48ec2550b None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:22.754997 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-c217dbe4-59f9-4dd8-ae55-bed48ec2550b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:22.761393 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e273f-e742-4f00-99a1-6b1ee353f9fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:22.763275 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855e273f-e742-4f00-99a1-6b1ee353f9fe None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:22.785988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-855e273f-e742-4f00-99a1-6b1ee353f9fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:22.785988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:22.785988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:22.785988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:22.785988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:22.785988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:22.785988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:22.785988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:22.785988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:22.785988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:22.785988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:22.785988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:22.785988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:22.785988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:22.785988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:22.786943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:22.786943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:22.786943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:22.786943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:22.786943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:22.786943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:22.786943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:22.786943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:22.786943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:22.786943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:22.786943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:22.786943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:22.786943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:22.786943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:22.786943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:22.786943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:22.786943 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:22.787885 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:22.787885 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:22.787885 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:22.787885 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:22.794760 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 342/684] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:22.796545 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e273f-e742-4f00-99a1-6b1ee353f9fe None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:22.852793 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 343/685] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:22 2022] POST /identity/v3/auth/tokens => generated 999 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 14 12:50:22.884213 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217dbe4-59f9-4dd8-ae55-bed48ec2550b None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:22.918607 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:22.939093 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855e273f-e742-4f00-99a1-6b1ee353f9fe None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:22.977662 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:22.983542 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4837cb-d0aa-4353-987e-20f03adf9405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:22.984789 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4837cb-d0aa-4353-987e-20f03adf9405 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:22.985073 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4837cb-d0aa-4353-987e-20f03adf9405 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:22.985380 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4837cb-d0aa-4353-987e-20f03adf9405 None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:22.986599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4837cb-d0aa-4353-987e-20f03adf9405 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:22.987054 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4837cb-d0aa-4353-987e-20f03adf9405 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:22.988671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4837cb-d0aa-4353-987e-20f03adf9405 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:23.005960 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c217dbe4-59f9-4dd8-ae55-bed48ec2550b None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:23.006299 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 343/686] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:23.011902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4837cb-d0aa-4353-987e-20f03adf9405 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:23.054981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23206f40-aef5-4e77-b7bf-6a979ec66408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:23.055913 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23206f40-aef5-4e77-b7bf-6a979ec66408 None admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:23.056262 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23206f40-aef5-4e77-b7bf-6a979ec66408 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:23.056604 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23206f40-aef5-4e77-b7bf-6a979ec66408 None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:23.057426 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23206f40-aef5-4e77-b7bf-6a979ec66408 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:23.059143 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23206f40-aef5-4e77-b7bf-6a979ec66408 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:23.120671 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 344/687] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 12:50:22 2022] POST /identity/v3/services => generated 240 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:50:23.144712 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4837cb-d0aa-4353-987e-20f03adf9405 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:23.194966 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa939a-4599-48af-bda6-eec9ab5e0c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:23.196195 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa939a-4599-48af-bda6-eec9ab5e0c11 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:23.196725 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa939a-4599-48af-bda6-eec9ab5e0c11 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:23.197204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aa939a-4599-48af-bda6-eec9ab5e0c11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:23.205826 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa939a-4599-48af-bda6-eec9ab5e0c11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:23.207738 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3aa939a-4599-48af-bda6-eec9ab5e0c11 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:23.224968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-f3aa939a-4599-48af-bda6-eec9ab5e0c11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:23.224968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:23.224968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:23.224968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:23.224968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:23.224968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:23.224968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:23.224968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:23.224968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:23.224968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:23.224968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:23.224968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:23.224968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:50:23.224968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:50:23.224968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:50:23.225926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:50:23.225926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:23.225926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:23.225926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:23.225926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:23.225926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:23.225926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:23.225926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:23.225926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:23.225926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:23.225926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:23.225926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:23.225926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:23.225926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:23.225926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:23.225926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:23.225926 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:23.226822 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:50:23.226822 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:50:23.226822 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:50:23.226822 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:50:23.226822 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:50:23.226822 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:50:23.226822 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:23.226822 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:23.229595 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 344/688] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:23.235480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23206f40-aef5-4e77-b7bf-6a979ec66408 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:23.340691 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:23.351806 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23206f40-aef5-4e77-b7bf-6a979ec66408 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:23.386891 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebb5f5-65ca-41dd-9bd8-bab70eadace9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:23.387564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebb5f5-65ca-41dd-9bd8-bab70eadace9 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:23.387851 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebb5f5-65ca-41dd-9bd8-bab70eadace9 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:23.388131 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebb5f5-65ca-41dd-9bd8-bab70eadace9 None admin] PATH_INFO: `/v3/projects` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:23.388976 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebb5f5-65ca-41dd-9bd8-bab70eadace9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:23.389515 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebb5f5-65ca-41dd-9bd8-bab70eadace9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:23.391170 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebb5f5-65ca-41dd-9bd8-bab70eadace9 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:23.404765 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 345/689] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:50:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:50:23.411006 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa939a-4599-48af-bda6-eec9ab5e0c11 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:23.467222 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:23.520710 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3aa939a-4599-48af-bda6-eec9ab5e0c11 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:23.557793 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f4d3b-6162-4525-8a49-f0f9dad13d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:23.559031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f4d3b-6162-4525-8a49-f0f9dad13d90 None admin] REQUEST_METHOD: `PUT` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:23.559542 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f4d3b-6162-4525-8a49-f0f9dad13d90 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:23.560013 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f4d3b-6162-4525-8a49-f0f9dad13d90 None admin] PATH_INFO: `/v3/projects/2a58a74d443e40a782112277c58028b6/users/1faa19de04744a4084a9c60c4af64f3e/roles/9bca71f77ac24a898d3445ab3c205809` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:23.562287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f4d3b-6162-4525-8a49-f0f9dad13d90 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a58a74d443e40a782112277c58028b6, user_id=1faa19de04744a4084a9c60c4af64f3e, role_id=9bca71f77ac24a898d3445ab3c205809)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:23.564082 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f4d3b-6162-4525-8a49-f0f9dad13d90 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:23.634652 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 345/690] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 12:50:23 2022] PUT /identity/v3/projects/2a58a74d443e40a782112277c58028b6/users/1faa19de04744a4084a9c60c4af64f3e/roles/9bca71f77ac24a898d3445ab3c205809 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 12:50:24.439520 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e097d-a6f0-4531-b1d3-7a5333eb8824 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:24.440059 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e097d-a6f0-4531-b1d3-7a5333eb8824 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:24.440059 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0e097d-a6f0-4531-b1d3-7a5333eb8824 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:24.441358 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 346/691] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:24.447008 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494811f-a6ea-4d7d-9f92-1b04cc8c9cd5 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:24.447449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494811f-a6ea-4d7d-9f92-1b04cc8c9cd5 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:24.447634 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494811f-a6ea-4d7d-9f92-1b04cc8c9cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:24.583050 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-9494811f-a6ea-4d7d-9f92-1b04cc8c9cd5 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:24.584503 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-9494811f-a6ea-4d7d-9f92-1b04cc8c9cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:24.660748 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 346/692] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:24 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:50:24.680093 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e097d-a6f0-4531-b1d3-7a5333eb8824 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:24.783935 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0e097d-a6f0-4531-b1d3-7a5333eb8824 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:24.819187 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad2bdb-377f-4119-a846-861fe9917e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:24.819984 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad2bdb-377f-4119-a846-861fe9917e86 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:24.820273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad2bdb-377f-4119-a846-861fe9917e86 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:24.820530 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ad2bdb-377f-4119-a846-861fe9917e86 None admin] PATH_INFO: `/v3/services/image` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:24.821209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad2bdb-377f-4119-a846-861fe9917e86 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:24.822748 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ad2bdb-377f-4119-a846-861fe9917e86 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:24.835733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-78ad2bdb-377f-4119-a846-861fe9917e86 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 12:50:24.835733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:24.835733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:50:24.835733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:50:24.835733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:50:24.835733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:50:24.835733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:50:24.835733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:24.835733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 12:50:24.835733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:24.835733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:24.835733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:24.835733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:24.835733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:24.835733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:24.835733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:24.835733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:24.839407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:24.839407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:24.839407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:24.839407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:24.839407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:24.839407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:24.839407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:50:24.839407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:50:24.839407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:50:24.839407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:50:24.839407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:24.839407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:24.839407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:24.839407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:24.839407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:24.839407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:24.840245 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:24.840245 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:24.840245 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:24.840245 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:24.840245 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:24.840245 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:24.840245 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:24.840245 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:24.840245 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:24.840245 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:24.840245 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:50:24.840245 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:24.840245 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 12:50:24.840245 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:24.841786 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 347/693] 10.222.0.40 () {56 vars in 1105 bytes} [Thu Jul 14 12:50:24 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:24.843947 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494811f-a6ea-4d7d-9f92-1b04cc8c9cd5 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:24.891289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:24.951276 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494811f-a6ea-4d7d-9f92-1b04cc8c9cd5 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:24.992369 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5d0ef-0451-431a-b703-94b9b176432a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:24.993075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5d0ef-0451-431a-b703-94b9b176432a None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:24.993363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5d0ef-0451-431a-b703-94b9b176432a None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:24.993637 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5d0ef-0451-431a-b703-94b9b176432a None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:24.994356 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5d0ef-0451-431a-b703-94b9b176432a None admin] RBAC: Adding query filter params (name=image) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:24.994662 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5d0ef-0451-431a-b703-94b9b176432a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:24.996076 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5d0ef-0451-431a-b703-94b9b176432a None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:25.001847 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 347/694] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:25.007293 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad2bdb-377f-4119-a846-861fe9917e86 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:25.038062 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:25.120258 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ad2bdb-377f-4119-a846-861fe9917e86 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:25.139531 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41854e88-4757-4492-be08-145651f5f0e8 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:25.141132 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41854e88-4757-4492-be08-145651f5f0e8 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:25.141422 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41854e88-4757-4492-be08-145651f5f0e8 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:25.142951 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 348/695] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:25.149198 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3993b-3e42-4e2d-afc7-38dd83662ee2 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:25.149492 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3993b-3e42-4e2d-afc7-38dd83662ee2 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:25.149775 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da3993b-3e42-4e2d-afc7-38dd83662ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:25.164499 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c393cfa-6989-4e31-920b-c48542191143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:25.165519 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c393cfa-6989-4e31-920b-c48542191143 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:25.166176 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c393cfa-6989-4e31-920b-c48542191143 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:25.166655 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c393cfa-6989-4e31-920b-c48542191143 None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:25.167036 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-4da3993b-3e42-4e2d-afc7-38dd83662ee2 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:25.167818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c393cfa-6989-4e31-920b-c48542191143 None admin] RBAC: Adding query filter params (type=image) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:25.168230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-4da3993b-3e42-4e2d-afc7-38dd83662ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:25.168569 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c393cfa-6989-4e31-920b-c48542191143 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:25.170159 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c393cfa-6989-4e31-920b-c48542191143 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:25.176611 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 348/696] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:25 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:25.186507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c393cfa-6989-4e31-920b-c48542191143 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:25.240121 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 349/697] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:25 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:50:25.264624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3993b-3e42-4e2d-afc7-38dd83662ee2 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:25.286369 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:25.303292 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:25.312795 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c393cfa-6989-4e31-920b-c48542191143 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:25.350524 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4dc3a-6071-4f37-bac3-23ad072f24ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:25.351394 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4dc3a-6071-4f37-bac3-23ad072f24ca None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:25.351680 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4dc3a-6071-4f37-bac3-23ad072f24ca None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:25.351960 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4dc3a-6071-4f37-bac3-23ad072f24ca None admin] PATH_INFO: `/v3/endpoints` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:25.352789 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4dc3a-6071-4f37-bac3-23ad072f24ca None admin] RBAC: Adding query filter params (interface=public, service_id=14556651ac914cf5baefc48656a2eedc, region_id=RegionOne) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:25.353127 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4dc3a-6071-4f37-bac3-23ad072f24ca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:25.354499 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4dc3a-6071-4f37-bac3-23ad072f24ca None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:25.363528 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 349/698] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 14 12:50:25 2022] GET /identity/v3/endpoints?service_id=14556651ac914cf5baefc48656a2eedc&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:25.369032 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4dc3a-6071-4f37-bac3-23ad072f24ca None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:25.380265 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da3993b-3e42-4e2d-afc7-38dd83662ee2 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:25.419415 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19232e5b-8414-4218-abd2-64ea36e3e395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:25.420520 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19232e5b-8414-4218-abd2-64ea36e3e395 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:25.420829 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19232e5b-8414-4218-abd2-64ea36e3e395 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:25.421691 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19232e5b-8414-4218-abd2-64ea36e3e395 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:25.422457 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19232e5b-8414-4218-abd2-64ea36e3e395 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:25.424057 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19232e5b-8414-4218-abd2-64ea36e3e395 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:25.437596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-19232e5b-8414-4218-abd2-64ea36e3e395 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 12:50:25.437596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:25.437596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:50:25.437596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:50:25.437596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:50:25.437596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:50:25.437596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:50:25.437596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:25.437596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 12:50:25.437596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:25.437596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:25.437596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:25.437596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:25.437596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:25.437596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:25.437596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:25.438611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:25.438611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:25.438611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:25.438611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:25.438611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:25.438611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:25.438611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:25.438611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:50:25.438611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:50:25.438611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:50:25.438611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:50:25.438611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:25.438611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:25.438611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:25.438611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:25.438611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:25.439472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:25.439472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:25.439472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:25.439472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:25.439472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:25.439472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:25.439472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:25.439472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:25.439472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:25.439472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:25.439472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:25.439472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:50:25.439472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:25.439472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 12:50:25.439472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:25.443999 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 350/699] 10.222.0.40 () {56 vars in 1129 bytes} [Thu Jul 14 12:50:25 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:50:25.445453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19232e5b-8414-4218-abd2-64ea36e3e395 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:25.492145 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4dc3a-6071-4f37-bac3-23ad072f24ca None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:25.543200 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2306686-5068-4061-b2d0-75284dbf4b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:25.544145 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2306686-5068-4061-b2d0-75284dbf4b8a None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:25.544481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2306686-5068-4061-b2d0-75284dbf4b8a None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:25.545270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:25.546135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2306686-5068-4061-b2d0-75284dbf4b8a None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:25.552659 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2306686-5068-4061-b2d0-75284dbf4b8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:25.552659 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2306686-5068-4061-b2d0-75284dbf4b8a None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:25.552883 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19232e5b-8414-4218-abd2-64ea36e3e395 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:25.560525 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 350/700] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 14 12:50:25 2022] GET /identity/v3/services => generated 1002 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:50:25.590547 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae25bec-c457-4617-ac23-9547f15e961e None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:25.590904 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae25bec-c457-4617-ac23-9547f15e961e None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:25.591121 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae25bec-c457-4617-ac23-9547f15e961e None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:25.597303 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 351/701] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:50:25.599273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aad68e-57e4-4aa0-9a76-8def679f49ab None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:25.599565 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aad68e-57e4-4aa0-9a76-8def679f49ab None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:25.599834 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03aad68e-57e4-4aa0-9a76-8def679f49ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:25.604077 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b7216-bb3c-4012-988a-c2f764d27a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:25.605710 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b7216-bb3c-4012-988a-c2f764d27a87 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:25.606233 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b7216-bb3c-4012-988a-c2f764d27a87 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:25.607358 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b7216-bb3c-4012-988a-c2f764d27a87 None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:25.608146 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b7216-bb3c-4012-988a-c2f764d27a87 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:25.608561 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b7216-bb3c-4012-988a-c2f764d27a87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:25.610592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b7216-bb3c-4012-988a-c2f764d27a87 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:25.617969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:25.623153 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 351/702] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jul 14 12:50:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:25.624163 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-03aad68e-57e4-4aa0-9a76-8def679f49ab None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:25.625483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-03aad68e-57e4-4aa0-9a76-8def679f49ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:25.630088 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b7216-bb3c-4012-988a-c2f764d27a87 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:25.704598 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 352/703] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:25 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:50:25.729541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aad68e-57e4-4aa0-9a76-8def679f49ab None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:25.770918 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b7216-bb3c-4012-988a-c2f764d27a87 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:25.825170 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71e147-060a-43db-b3d3-a23e8b280dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:25.825790 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71e147-060a-43db-b3d3-a23e8b280dc5 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:25.826676 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71e147-060a-43db-b3d3-a23e8b280dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:25.826980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d71e147-060a-43db-b3d3-a23e8b280dc5 None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:25.829036 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71e147-060a-43db-b3d3-a23e8b280dc5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:25.829036 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71e147-060a-43db-b3d3-a23e8b280dc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:25.830105 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d71e147-060a-43db-b3d3-a23e8b280dc5 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:25.843516 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 352/704] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jul 14 12:50:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:25.845307 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71e147-060a-43db-b3d3-a23e8b280dc5 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:25.859992 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03aad68e-57e4-4aa0-9a76-8def679f49ab None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:25.874754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:25.898315 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ab138-0a18-4ed9-9aca-f1f031eb52a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:25.899145 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ab138-0a18-4ed9-9aca-f1f031eb52a8 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:25.899402 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ab138-0a18-4ed9-9aca-f1f031eb52a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:25.899678 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29ab138-0a18-4ed9-9aca-f1f031eb52a8 None admin] PATH_INFO: `/v3/services/network` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:25.900333 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ab138-0a18-4ed9-9aca-f1f031eb52a8 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:25.901879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29ab138-0a18-4ed9-9aca-f1f031eb52a8 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:25.905028 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:25.916366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-d29ab138-0a18-4ed9-9aca-f1f031eb52a8 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 12:50:25.916366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:25.916366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:50:25.916366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:50:25.916366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:50:25.916366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:50:25.916366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:50:25.916366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:25.916366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 12:50:25.916366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:25.916366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:25.916366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:25.916366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:25.916366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:25.916366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:25.916366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:25.916366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:25.919676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:25.919676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:25.919676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:25.919676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:25.919676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:25.919676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:25.919676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:50:25.919676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:50:25.919676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:50:25.919676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:50:25.919676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:25.919676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:25.919676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:25.919676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:25.919676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:25.919676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:25.920608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:25.920608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:25.920608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:25.920608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:25.920608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:25.920608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:25.920608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:25.920608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:25.920608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:25.920608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:25.920608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:50:25.920608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:25.920608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 12:50:25.920608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:25.922650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 353/705] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:25 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:50:25.923714 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ab138-0a18-4ed9-9aca-f1f031eb52a8 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:25.977629 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d71e147-060a-43db-b3d3-a23e8b280dc5 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:26.016958 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4112b2c-9814-4380-a084-6140de10ad28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:26.017758 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4112b2c-9814-4380-a084-6140de10ad28 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:26.018107 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4112b2c-9814-4380-a084-6140de10ad28 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:26.018448 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4112b2c-9814-4380-a084-6140de10ad28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:26.019304 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4112b2c-9814-4380-a084-6140de10ad28 None admin] RBAC: Adding query filter params (interface=public, service_id=ba2597003ca44f03a6aef0b76fcc2794, region_id=RegionOne) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:26.019616 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4112b2c-9814-4380-a084-6140de10ad28 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:26.021010 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4112b2c-9814-4380-a084-6140de10ad28 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:26.028617 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 353/706] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 14 12:50:25 2022] GET /identity/v3/endpoints?service_id=ba2597003ca44f03a6aef0b76fcc2794&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:50:26.034074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019cfd0-4c18-4666-96b4-16fea6b0a4bc None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:26.034367 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019cfd0-4c18-4666-96b4-16fea6b0a4bc None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:26.034645 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a019cfd0-4c18-4666-96b4-16fea6b0a4bc None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:26.035994 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 354/707] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:26.036780 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019cfd0-4c18-4666-96b4-16fea6b0a4bc None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:26.038919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29ab138-0a18-4ed9-9aca-f1f031eb52a8 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:26.074493 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a963b-784f-4c42-af52-5b3e9f1423a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:26.075165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a963b-784f-4c42-af52-5b3e9f1423a8 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:26.075504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a963b-784f-4c42-af52-5b3e9f1423a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:26.075726 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a963b-784f-4c42-af52-5b3e9f1423a8 None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:26.076430 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a963b-784f-4c42-af52-5b3e9f1423a8 None admin] RBAC: Adding query filter params (name=network) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:26.076773 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a963b-784f-4c42-af52-5b3e9f1423a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:26.078501 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a963b-784f-4c42-af52-5b3e9f1423a8 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:26.083321 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 354/708] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 12:50:25 2022] GET /identity/v3/services?name=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:26.084816 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd19bc7-8062-437c-a514-75481a421ff9 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:26.085107 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd19bc7-8062-437c-a514-75481a421ff9 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:26.085393 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd19bc7-8062-437c-a514-75481a421ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:26.104316 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-efd19bc7-8062-437c-a514-75481a421ff9 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:26.105622 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-efd19bc7-8062-437c-a514-75481a421ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:26.148199 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:26.161552 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a019cfd0-4c18-4666-96b4-16fea6b0a4bc None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:26.186487 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:26.188033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 355/709] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:26 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:50:26.188911 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd19bc7-8062-437c-a514-75481a421ff9 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:26.202743 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df909262-805f-4c62-91bf-c2d97b43e6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:26.203443 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df909262-805f-4c62-91bf-c2d97b43e6e7 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:26.203806 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df909262-805f-4c62-91bf-c2d97b43e6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:26.204160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df909262-805f-4c62-91bf-c2d97b43e6e7 None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:26.204966 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df909262-805f-4c62-91bf-c2d97b43e6e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:26.206441 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df909262-805f-4c62-91bf-c2d97b43e6e7 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:26.219469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 355/710] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 14 12:50:26 2022] GET /identity/v3/services => generated 1002 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:50:26.219469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df909262-805f-4c62-91bf-c2d97b43e6e7 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:26.321431 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd19bc7-8062-437c-a514-75481a421ff9 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:26.352342 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df909262-805f-4c62-91bf-c2d97b43e6e7 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:26.361075 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07901bc6-7409-4baa-a236-96ec11199768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:26.361762 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07901bc6-7409-4baa-a236-96ec11199768 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:26.362051 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07901bc6-7409-4baa-a236-96ec11199768 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:26.362332 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07901bc6-7409-4baa-a236-96ec11199768 None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:26.363059 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07901bc6-7409-4baa-a236-96ec11199768 None admin] RBAC: Adding query filter params (type=network) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:26.363372 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07901bc6-7409-4baa-a236-96ec11199768 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:26.364804 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07901bc6-7409-4baa-a236-96ec11199768 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:26.370659 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 356/711] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 12:50:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:26.377223 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07901bc6-7409-4baa-a236-96ec11199768 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:26.403179 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239055e-e86a-43aa-afd9-de4f8b4ee8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:26.403983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239055e-e86a-43aa-afd9-de4f8b4ee8de None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:26.404321 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239055e-e86a-43aa-afd9-de4f8b4ee8de None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:26.404604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239055e-e86a-43aa-afd9-de4f8b4ee8de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:26.420375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239055e-e86a-43aa-afd9-de4f8b4ee8de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:50:26.428602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-6239055e-e86a-43aa-afd9-de4f8b4ee8de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:50:26.428602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:26.428602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:26.428602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:26.428602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:26.428602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:26.428602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:26.428602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:26.428602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:26.428602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:26.428602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:26.428602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:26.428602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:50:26.428602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:50:26.428602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:50:26.428602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:50:26.429694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:50:26.429694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:50:26.429694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:50:26.429694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:50:26.429694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:26.429694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:26.429694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:26.429694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:26.429694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:26.429694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:26.429694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:26.429694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:26.429694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:26.429694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:26.429694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:26.429694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:26.430757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:26.430757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:26.430757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:26.430757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:26.430757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:50:26.430757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:50:26.430757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:50:26.430757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:50:26.430757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:50:26.430757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:50:26.430757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:50:26.430757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:26.430757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 356/712] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 12:50:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:50:26.438214 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239055e-e86a-43aa-afd9-de4f8b4ee8de None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:26.455488 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:26.460810 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:26.504315 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07901bc6-7409-4baa-a236-96ec11199768 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:26.544501 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c23b2-8fa5-454c-8e71-79fac130a2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:26.545540 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c23b2-8fa5-454c-8e71-79fac130a2fa None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:26.546034 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c23b2-8fa5-454c-8e71-79fac130a2fa None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:26.546493 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896c23b2-8fa5-454c-8e71-79fac130a2fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:26.547459 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c23b2-8fa5-454c-8e71-79fac130a2fa None admin] RBAC: Adding query filter params (interface=public, service_id=5d7c8099b0404048905b04fc6d348f7f, region_id=RegionOne) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:26.547964 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c23b2-8fa5-454c-8e71-79fac130a2fa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:26.549548 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896c23b2-8fa5-454c-8e71-79fac130a2fa None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:26.555504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 357/713] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 14 12:50:26 2022] GET /identity/v3/endpoints?service_id=5d7c8099b0404048905b04fc6d348f7f&interface=public®ion_id=RegionOne => generated 194 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:50:26.560177 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239055e-e86a-43aa-afd9-de4f8b4ee8de None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:26.565865 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c23b2-8fa5-454c-8e71-79fac130a2fa None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:26.598017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6d593-0065-4f79-91c4-66da1193345c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:26.599025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6d593-0065-4f79-91c4-66da1193345c None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:26.599522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6d593-0065-4f79-91c4-66da1193345c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:26.600000 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6d593-0065-4f79-91c4-66da1193345c None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:26.600948 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6d593-0065-4f79-91c4-66da1193345c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:26.601433 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6d593-0065-4f79-91c4-66da1193345c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:26.603105 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee6d593-0065-4f79-91c4-66da1193345c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:26.617034 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 357/714] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:50:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:26.619244 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6d593-0065-4f79-91c4-66da1193345c None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:26.700111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896c23b2-8fa5-454c-8e71-79fac130a2fa None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:26.709117 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:26.726455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:26.738229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a2211-ecf9-4fd3-8e8e-ef2ef673841b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:26.739020 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a2211-ecf9-4fd3-8e8e-ef2ef673841b None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:26.739270 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a2211-ecf9-4fd3-8e8e-ef2ef673841b None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:26.739625 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9a2211-ecf9-4fd3-8e8e-ef2ef673841b None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:26.740617 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a2211-ecf9-4fd3-8e8e-ef2ef673841b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:26.742134 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9a2211-ecf9-4fd3-8e8e-ef2ef673841b None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:26.746788 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6d593-0065-4f79-91c4-66da1193345c None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:26.752808 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 358/715] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 14 12:50:26 2022] GET /identity/v3/services => generated 1002 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 12:50:26.791484 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89470ecf-32bf-43d7-8d60-fab99694b0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:26.792752 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89470ecf-32bf-43d7-8d60-fab99694b0de None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:26.793252 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89470ecf-32bf-43d7-8d60-fab99694b0de None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:26.793762 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89470ecf-32bf-43d7-8d60-fab99694b0de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:26.807083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89470ecf-32bf-43d7-8d60-fab99694b0de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:26.808588 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89470ecf-32bf-43d7-8d60-fab99694b0de None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:26.828621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-89470ecf-32bf-43d7-8d60-fab99694b0de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:26.828621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:26.828621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:26.828621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:26.828621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:26.828621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:26.828621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:26.828621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:26.828621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:26.828621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:26.828621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:26.828621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:26.828621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:26.828621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:26.828621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:26.829624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:26.829624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:26.829624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:26.829624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:26.829624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:26.829624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:26.829624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:26.829624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:26.829624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:26.829624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:26.829624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:26.829624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:26.829624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:26.829624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:26.829624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:26.829624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:26.829624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:26.830506 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:26.830506 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:26.830506 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:26.830506 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:26.830506 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 358/716] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:26.837668 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a2211-ecf9-4fd3-8e8e-ef2ef673841b None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:26.948044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9a2211-ecf9-4fd3-8e8e-ef2ef673841b None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:26.985711 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c715a3b-d68b-4a2c-889a-557561f09a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:26.986783 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c715a3b-d68b-4a2c-889a-557561f09a66 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:26.987349 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c715a3b-d68b-4a2c-889a-557561f09a66 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:26.987859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c715a3b-d68b-4a2c-889a-557561f09a66 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:26.988866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c715a3b-d68b-4a2c-889a-557561f09a66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:26.989377 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c715a3b-d68b-4a2c-889a-557561f09a66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:26.990983 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c715a3b-d68b-4a2c-889a-557561f09a66 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:27.006721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 359/717] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:27.014657 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89470ecf-32bf-43d7-8d60-fab99694b0de None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:27.133296 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89470ecf-32bf-43d7-8d60-fab99694b0de None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:27.166304 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:27.175082 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f55644-eef5-4d3c-afc9-223dff4adc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:27.175865 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f55644-eef5-4d3c-afc9-223dff4adc7c None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:27.176145 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f55644-eef5-4d3c-afc9-223dff4adc7c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:27.176420 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f55644-eef5-4d3c-afc9-223dff4adc7c None admin] PATH_INFO: `/v3/users/nova` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:27.184530 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f55644-eef5-4d3c-afc9-223dff4adc7c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:27.186013 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f55644-eef5-4d3c-afc9-223dff4adc7c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:27.200965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-12f55644-eef5-4d3c-afc9-223dff4adc7c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 14 12:50:27.200965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:27.200965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:27.200965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:27.200965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:27.200965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:27.200965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:27.200965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:27.200965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:27.200965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:27.200965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:27.200965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:27.200965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:50:27.200965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:50:27.200965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:50:27.200965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:50:27.201881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:27.201881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:27.201881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:50:27.201881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:27.201881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:50:27.201881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:27.201881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:27.201881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:27.201881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:27.201881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:27.201881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:27.201881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:27.201881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:27.201881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:27.201881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:27.201881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:27.201881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:27.201881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:27.203504 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:27.203504 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:27.203504 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:50:27.203504 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:50:27.203504 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:50:27.203504 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:50:27.203504 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:50:27.203504 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:50:27.203504 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 14 12:50:27.203504 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:27.203504 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 359/718] 10.222.0.40 () {56 vars in 1093 bytes} [Thu Jul 14 12:50:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:50:27.210488 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c715a3b-d68b-4a2c-889a-557561f09a66 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:27.259945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:27.325525 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c715a3b-d68b-4a2c-889a-557561f09a66 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:27.362316 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f2777-b322-4939-a7b2-04668dcc148c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:27.363042 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f2777-b322-4939-a7b2-04668dcc148c None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:27.363334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f2777-b322-4939-a7b2-04668dcc148c None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:27.363616 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4f2777-b322-4939-a7b2-04668dcc148c None admin] PATH_INFO: `/v3/users` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:27.364452 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f2777-b322-4939-a7b2-04668dcc148c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:27.364798 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f2777-b322-4939-a7b2-04668dcc148c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:27.366260 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4f2777-b322-4939-a7b2-04668dcc148c None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:27.385846 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 360/719] 10.222.0.40 () {56 vars in 1133 bytes} [Thu Jul 14 12:50:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:27.392302 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f55644-eef5-4d3c-afc9-223dff4adc7c None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:27.501063 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f55644-eef5-4d3c-afc9-223dff4adc7c None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:27.538422 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bde86-46bc-4556-886b-3ed123a5f1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:27.539077 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bde86-46bc-4556-886b-3ed123a5f1c1 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:27.539367 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bde86-46bc-4556-886b-3ed123a5f1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:27.539647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1bde86-46bc-4556-886b-3ed123a5f1c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:27.601138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:27.616256 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bde86-46bc-4556-886b-3ed123a5f1c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:27.617848 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1bde86-46bc-4556-886b-3ed123a5f1c1 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:27.725099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 360/720] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:50:27 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 12:50:27.734307 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f2777-b322-4939-a7b2-04668dcc148c None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:27.838716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4f2777-b322-4939-a7b2-04668dcc148c None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:27.841078 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:27.879450 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76efc046-38db-4f77-910a-8d23fe88ebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:27.880248 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efc046-38db-4f77-910a-8d23fe88ebc5 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:27.880539 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efc046-38db-4f77-910a-8d23fe88ebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:27.880855 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76efc046-38db-4f77-910a-8d23fe88ebc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:27.891437 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efc046-38db-4f77-910a-8d23fe88ebc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:27.892985 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76efc046-38db-4f77-910a-8d23fe88ebc5 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:27.912221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-76efc046-38db-4f77-910a-8d23fe88ebc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:27.912221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:27.912221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:27.912221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:27.912221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:27.912221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:27.912221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:27.912221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:27.912221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:27.912221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:27.912221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:27.912221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:27.912221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:27.912221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:27.912221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:27.913366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:27.913366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:27.913366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:27.913366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:27.913366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:27.913366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:27.913366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:27.913366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:27.913366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:27.913366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:27.913366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:27.913366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:27.913366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:27.913366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:27.913366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:27.913366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:27.913366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:27.914642 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:27.914642 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:27.914642 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:27.914642 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:27.914642 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 361/721] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:27.922421 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bde86-46bc-4556-886b-3ed123a5f1c1 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:27.969870 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aefe66-95e9-4a40-a9e7-7b6f0ce93417 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:27.970157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aefe66-95e9-4a40-a9e7-7b6f0ce93417 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:27.970444 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aefe66-95e9-4a40-a9e7-7b6f0ce93417 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:27.972061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 362/722] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:50:27.977062 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536f82c-9db6-41bf-b831-d506d47e8dbe None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:27.977357 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536f82c-9db6-41bf-b831-d506d47e8dbe None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:27.977618 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536f82c-9db6-41bf-b831-d506d47e8dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:27.998198 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-d536f82c-9db6-41bf-b831-d506d47e8dbe None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:27.999436 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-d536f82c-9db6-41bf-b831-d506d47e8dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:28.028908 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:28.056014 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1bde86-46bc-4556-886b-3ed123a5f1c1 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:28.076260 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 363/723] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:27 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 12:50:28.098219 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f952fc5-a246-4efb-ab54-ba8c8c84aac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:28.099147 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f952fc5-a246-4efb-ab54-ba8c8c84aac8 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:28.099690 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f952fc5-a246-4efb-ab54-ba8c8c84aac8 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:28.100127 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f952fc5-a246-4efb-ab54-ba8c8c84aac8 None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:28.100874 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536f82c-9db6-41bf-b831-d506d47e8dbe None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:28.100986 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f952fc5-a246-4efb-ab54-ba8c8c84aac8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:28.101182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f952fc5-a246-4efb-ab54-ba8c8c84aac8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:28.102570 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f952fc5-a246-4efb-ab54-ba8c8c84aac8 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:28.127636 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 361/724] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:28.133092 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f952fc5-a246-4efb-ab54-ba8c8c84aac8 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:28.203174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:28.219998 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536f82c-9db6-41bf-b831-d506d47e8dbe None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:28.256463 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f952fc5-a246-4efb-ab54-ba8c8c84aac8 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:28.293437 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb92c2-ba7c-40b1-8002-a3da6c0e499c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:28.296735 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb92c2-ba7c-40b1-8002-a3da6c0e499c None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:28.296735 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb92c2-ba7c-40b1-8002-a3da6c0e499c None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:28.296735 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb92c2-ba7c-40b1-8002-a3da6c0e499c None admin] PATH_INFO: `/v3/services/image` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:28.296735 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb92c2-ba7c-40b1-8002-a3da6c0e499c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:28.297379 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb92c2-ba7c-40b1-8002-a3da6c0e499c None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:28.311271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb0159-8074-47e0-b90f-acec4645af38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:28.311271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb0159-8074-47e0-b90f-acec4645af38 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:28.311271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb0159-8074-47e0-b90f-acec4645af38 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:28.311271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fb0159-8074-47e0-b90f-acec4645af38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:28.326587 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb0159-8074-47e0-b90f-acec4645af38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:28.326751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-69cb92c2-ba7c-40b1-8002-a3da6c0e499c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 12:50:28.326751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:28.326751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:50:28.326751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:50:28.326751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:50:28.326751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:50:28.326751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:50:28.326751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:28.326751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 12:50:28.326751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:28.326751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:28.326751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:28.326751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:28.326751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:28.326751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:28.326751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:28.326751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:28.328234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:28.328234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:28.328234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:28.328234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:28.328234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:28.328234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:28.328234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:50:28.328234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:50:28.328234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:50:28.328234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:50:28.328234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:28.328234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:28.328234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:28.328234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:28.328234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:28.328234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:28.329498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:28.329498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:28.329498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:28.329498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:28.329498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:28.329498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:28.329498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:28.329498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:28.329498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:28.329498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:28.329498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:50:28.329498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:28.329498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 14 12:50:28.329498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:28.332062 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fb0159-8074-47e0-b90f-acec4645af38 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:28.337901 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 364/725] 10.222.0.40 () {56 vars in 1105 bytes} [Thu Jul 14 12:50:28 2022] GET /identity/v3/services/image => generated 86 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:28.338502 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb92c2-ba7c-40b1-8002-a3da6c0e499c None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:28.353375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-35fb0159-8074-47e0-b90f-acec4645af38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:28.353375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:28.353375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:28.353375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:28.353375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:28.353375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:28.353375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:28.353375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:28.353375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:28.353375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:28.353375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:28.353375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:28.353375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:50:28.353375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:50:28.353375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:50:28.354270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:50:28.354270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:28.354270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:28.354270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:28.354270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:28.354270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:28.354270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:28.354270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:28.354270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:28.354270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:28.354270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:28.354270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:28.354270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:28.354270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:28.354270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:28.354270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:28.354270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:28.355194 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:50:28.355194 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:50:28.355194 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:50:28.355194 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:50:28.355194 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:50:28.355194 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:50:28.355194 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:28.355194 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:28.359324 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 362/726] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:28.363835 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb0159-8074-47e0-b90f-acec4645af38 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:28.383191 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:28.489698 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb92c2-ba7c-40b1-8002-a3da6c0e499c None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:28.533199 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fb0159-8074-47e0-b90f-acec4645af38 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:28.552479 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56b8be-a2b6-44b1-bfd2-77368a7038e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:28.553845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56b8be-a2b6-44b1-bfd2-77368a7038e0 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:28.555047 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56b8be-a2b6-44b1-bfd2-77368a7038e0 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:28.555865 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf56b8be-a2b6-44b1-bfd2-77368a7038e0 None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:28.557147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56b8be-a2b6-44b1-bfd2-77368a7038e0 None admin] RBAC: Adding query filter params (name=image) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:28.558276 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56b8be-a2b6-44b1-bfd2-77368a7038e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:28.561711 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf56b8be-a2b6-44b1-bfd2-77368a7038e0 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:28.579845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 365/727] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:28 2022] GET /identity/v3/services?name=image => generated 122 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:28.581578 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56b8be-a2b6-44b1-bfd2-77368a7038e0 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:28.614690 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8ffa3-866e-40d8-b475-441024f7e15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:28.615308 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8ffa3-866e-40d8-b475-441024f7e15f None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:28.615760 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8ffa3-866e-40d8-b475-441024f7e15f None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:28.616045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b8ffa3-866e-40d8-b475-441024f7e15f None admin] PATH_INFO: `/v3/projects` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:28.618318 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:28.620273 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8ffa3-866e-40d8-b475-441024f7e15f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:28.621092 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8ffa3-866e-40d8-b475-441024f7e15f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:28.623759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b8ffa3-866e-40d8-b475-441024f7e15f None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:28.643457 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 363/728] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:50:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:28.646023 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8ffa3-866e-40d8-b475-441024f7e15f None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:28.744571 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:28.773581 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf56b8be-a2b6-44b1-bfd2-77368a7038e0 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:28.786236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b8ffa3-866e-40d8-b475-441024f7e15f None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:28.810707 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958f89f5-9d26-4245-a979-5d0c7240f829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:28.811406 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f89f5-9d26-4245-a979-5d0c7240f829 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:28.811733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f89f5-9d26-4245-a979-5d0c7240f829 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:28.812491 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958f89f5-9d26-4245-a979-5d0c7240f829 None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:28.813226 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f89f5-9d26-4245-a979-5d0c7240f829 None admin] RBAC: Adding query filter params (type=image) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:28.813529 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f89f5-9d26-4245-a979-5d0c7240f829 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:28.814905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958f89f5-9d26-4245-a979-5d0c7240f829 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:28.820658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 366/729] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:28 2022] GET /identity/v3/services?type=image => generated 350 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:28.822012 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6faf4d-4d14-4abd-876f-6c803d91ce21 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:28.822344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6faf4d-4d14-4abd-876f-6c803d91ce21 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:28.822571 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6faf4d-4d14-4abd-876f-6c803d91ce21 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:28.823904 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 367/730] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:28.826111 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56c0585-c5eb-491a-b086-c70c40ffa92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:28.826984 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c0585-c5eb-491a-b086-c70c40ffa92c None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:28.832085 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c0585-c5eb-491a-b086-c70c40ffa92c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:28.832085 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56c0585-c5eb-491a-b086-c70c40ffa92c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:28.832254 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6faf4d-4d14-4abd-876f-6c803d91ce21 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:28.832365 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c0585-c5eb-491a-b086-c70c40ffa92c None admin] RBAC: Adding query filter params (role.id=9bca71f77ac24a898d3445ab3c205809, scope.project.id=2a58a74d443e40a782112277c58028b6, user.id=1faa19de04744a4084a9c60c4af64f3e) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:28.832365 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c0585-c5eb-491a-b086-c70c40ffa92c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:28.832365 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56c0585-c5eb-491a-b086-c70c40ffa92c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:28.838479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 364/731] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:50:28 2022] GET /identity/v3/role_assignments?user.id=1faa19de04744a4084a9c60c4af64f3e&scope.project.id=2a58a74d443e40a782112277c58028b6&role.id=9bca71f77ac24a898d3445ab3c205809 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:50:28.839976 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd91e5e-5cd1-44fa-bac0-6cc6a81d3a1e None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:28.840267 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd91e5e-5cd1-44fa-bac0-6cc6a81d3a1e None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:28.840559 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd91e5e-5cd1-44fa-bac0-6cc6a81d3a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:28.863818 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-6bd91e5e-5cd1-44fa-bac0-6cc6a81d3a1e None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:28.865254 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-6bd91e5e-5cd1-44fa-bac0-6cc6a81d3a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:28.950732 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 365/732] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:28 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:50:28.961825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:28.981024 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd91e5e-5cd1-44fa-bac0-6cc6a81d3a1e None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:28.990713 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6faf4d-4d14-4abd-876f-6c803d91ce21 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:29.031228 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5242069-1a3c-42ea-af55-240c095212c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:29.031900 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5242069-1a3c-42ea-af55-240c095212c1 None admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:29.032191 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5242069-1a3c-42ea-af55-240c095212c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:29.032473 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5242069-1a3c-42ea-af55-240c095212c1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:29.033266 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5242069-1a3c-42ea-af55-240c095212c1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:29.035300 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5242069-1a3c-42ea-af55-240c095212c1 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:29.067043 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:29.113169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd91e5e-5cd1-44fa-bac0-6cc6a81d3a1e None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:29.144294 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 368/733] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 14 12:50:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:50:29.177754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c1fbf6-8fe2-4890-ba8f-8751fec04168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:29.178934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1fbf6-8fe2-4890-ba8f-8751fec04168 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:29.179444 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1fbf6-8fe2-4890-ba8f-8751fec04168 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:29.179954 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c1fbf6-8fe2-4890-ba8f-8751fec04168 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:29.180924 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1fbf6-8fe2-4890-ba8f-8751fec04168 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:29.182770 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c1fbf6-8fe2-4890-ba8f-8751fec04168 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:29.199285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-84c1fbf6-8fe2-4890-ba8f-8751fec04168 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 12:50:29.199285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:29.199285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:50:29.199285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:50:29.199285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:50:29.199285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:50:29.199285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:50:29.199285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:29.199285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 12:50:29.199285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:29.199285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:29.199285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:29.199285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:29.199285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:29.199285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:29.199285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:29.200374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:29.200374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:29.200374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:29.200374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:29.200374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:29.200374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:29.200374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:29.200374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:50:29.200374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:50:29.200374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:50:29.200374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:50:29.200374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:29.200374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:29.200374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:29.200374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:29.200374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:29.201260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:29.201260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:29.201260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:29.201260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:29.201260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:29.201260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:29.201260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:29.201260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:29.201260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:29.201260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:29.201260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:29.201260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:50:29.201260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:29.201260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 14 12:50:29.201260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:29.204121 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 366/734] 10.222.0.40 () {56 vars in 1129 bytes} [Thu Jul 14 12:50:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:50:29.210591 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5242069-1a3c-42ea-af55-240c095212c1 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:29.240481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42160915-e580-4edf-b666-cbedb6f746bc None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:29.240829 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42160915-e580-4edf-b666-cbedb6f746bc None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:29.241103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42160915-e580-4edf-b666-cbedb6f746bc None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:29.242817 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 367/735] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:29.249011 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e181151-1e8d-4b54-a418-c6703c29a23f None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:29.249234 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e181151-1e8d-4b54-a418-c6703c29a23f None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:29.249470 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e181151-1e8d-4b54-a418-c6703c29a23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:29.268586 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-4e181151-1e8d-4b54-a418-c6703c29a23f None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:29.269985 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-4e181151-1e8d-4b54-a418-c6703c29a23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:29.341173 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5242069-1a3c-42ea-af55-240c095212c1 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:29.368443 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 368/736] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:29 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 12:50:29.391752 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9a9fd-cf4c-46f7-b368-145ebf3213e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:29.392807 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9a9fd-cf4c-46f7-b368-145ebf3213e5 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:29.393106 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e181151-1e8d-4b54-a418-c6703c29a23f None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:29.393203 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9a9fd-cf4c-46f7-b368-145ebf3213e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:29.393378 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b9a9fd-cf4c-46f7-b368-145ebf3213e5 None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:29.394085 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9a9fd-cf4c-46f7-b368-145ebf3213e5 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:29.394380 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9a9fd-cf4c-46f7-b368-145ebf3213e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:29.395792 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b9a9fd-cf4c-46f7-b368-145ebf3213e5 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:29.397238 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:29.403204 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 369/737] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jul 14 12:50:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:29.409196 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9a9fd-cf4c-46f7-b368-145ebf3213e5 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:29.458681 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:29.512982 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e181151-1e8d-4b54-a418-c6703c29a23f None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:29.537581 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b9a9fd-cf4c-46f7-b368-145ebf3213e5 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:29.550659 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c03645-8898-4b1b-838e-9a4ba56bbfcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:29.551728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c03645-8898-4b1b-838e-9a4ba56bbfcf None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:29.552170 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c03645-8898-4b1b-838e-9a4ba56bbfcf None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:29.552597 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c03645-8898-4b1b-838e-9a4ba56bbfcf None admin] PATH_INFO: `/v3/services/network` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:29.553459 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c03645-8898-4b1b-838e-9a4ba56bbfcf None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:29.554991 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c03645-8898-4b1b-838e-9a4ba56bbfcf None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:29.567474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-70c03645-8898-4b1b-838e-9a4ba56bbfcf None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 12:50:29.567474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:29.567474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:50:29.567474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:50:29.567474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:50:29.567474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:50:29.567474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:50:29.567474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:29.567474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 12:50:29.567474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:29.567474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:29.567474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:29.567474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:29.567474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:29.567474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:29.567474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:29.567474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:29.568782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:29.568782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:29.568782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:29.568782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:29.568782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:29.568782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:29.568782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:50:29.568782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:50:29.568782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:50:29.568782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:50:29.568782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:29.568782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:29.568782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:29.568782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:29.568782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:29.568782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:29.569754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:29.569754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:29.569754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:29.569754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:29.569754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:29.569754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:29.569754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:29.569754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:29.569754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:29.569754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:29.569754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:50:29.569754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:29.569754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 14 12:50:29.569754 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:29.572270 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 369/738] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:29 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:50:29.580700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c03645-8898-4b1b-838e-9a4ba56bbfcf None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:29.580867 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100ca8f-afa6-4e63-bd72-b22a20edbeb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:29.580867 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100ca8f-afa6-4e63-bd72-b22a20edbeb6 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:29.580867 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100ca8f-afa6-4e63-bd72-b22a20edbeb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:29.580867 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d100ca8f-afa6-4e63-bd72-b22a20edbeb6 None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:29.581177 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100ca8f-afa6-4e63-bd72-b22a20edbeb6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:29.581424 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100ca8f-afa6-4e63-bd72-b22a20edbeb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:29.583566 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d100ca8f-afa6-4e63-bd72-b22a20edbeb6 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:29.592733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 370/739] 10.222.0.40 () {56 vars in 1124 bytes} [Thu Jul 14 12:50:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:50:29.597436 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100ca8f-afa6-4e63-bd72-b22a20edbeb6 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:29.666246 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:29.700332 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c03645-8898-4b1b-838e-9a4ba56bbfcf None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:29.718943 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d100ca8f-afa6-4e63-bd72-b22a20edbeb6 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:29.722863 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:29.747554 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c74a68-e8a6-4451-9141-fc5cc2ddf2b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:29.748229 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c74a68-e8a6-4451-9141-fc5cc2ddf2b7 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:29.748515 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c74a68-e8a6-4451-9141-fc5cc2ddf2b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:29.749151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c74a68-e8a6-4451-9141-fc5cc2ddf2b7 None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:29.749673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c74a68-e8a6-4451-9141-fc5cc2ddf2b7 None admin] RBAC: Adding query filter params (name=network) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:29.749982 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c74a68-e8a6-4451-9141-fc5cc2ddf2b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:29.751380 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c74a68-e8a6-4451-9141-fc5cc2ddf2b7 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:29.758143 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 370/740] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 12:50:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:29.763291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5e9eb-7940-4e61-b3d2-719f4e217b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:29.763549 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c74a68-e8a6-4451-9141-fc5cc2ddf2b7 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:29.764498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5e9eb-7940-4e61-b3d2-719f4e217b03 None admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:29.765612 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5e9eb-7940-4e61-b3d2-719f4e217b03 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:29.766083 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5e9eb-7940-4e61-b3d2-719f4e217b03 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:29.767134 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5e9eb-7940-4e61-b3d2-719f4e217b03 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:29.768861 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5e9eb-7940-4e61-b3d2-719f4e217b03 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:29.861255 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 371/741] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 14 12:50:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:50:29.875517 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c74a68-e8a6-4451-9141-fc5cc2ddf2b7 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:29.922951 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5b84f3-0e8e-4b58-9c08-e680fa49470a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:29.923634 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b84f3-0e8e-4b58-9c08-e680fa49470a None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:29.923924 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b84f3-0e8e-4b58-9c08-e680fa49470a None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:29.924201 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5b84f3-0e8e-4b58-9c08-e680fa49470a None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:29.925002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b84f3-0e8e-4b58-9c08-e680fa49470a None admin] RBAC: Adding query filter params (type=network) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:29.925311 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b84f3-0e8e-4b58-9c08-e680fa49470a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:29.926726 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5b84f3-0e8e-4b58-9c08-e680fa49470a None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:29.937682 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 371/742] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 12:50:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:29.939462 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5e9eb-7940-4e61-b3d2-719f4e217b03 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:30.068629 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5e9eb-7940-4e61-b3d2-719f4e217b03 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:30.088461 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:30.107328 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b069a476-9ecb-437c-801a-649e3c9e6cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:30.108026 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069a476-9ecb-437c-801a-649e3c9e6cdd None admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:30.108330 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069a476-9ecb-437c-801a-649e3c9e6cdd None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:30.109597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b069a476-9ecb-437c-801a-649e3c9e6cdd None admin] PATH_INFO: `/v3/endpoints` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:30.109597 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069a476-9ecb-437c-801a-649e3c9e6cdd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:30.110980 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b069a476-9ecb-437c-801a-649e3c9e6cdd None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:30.194188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 372/743] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 14 12:50:29 2022] POST /identity/v3/endpoints => generated 327 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:50:31.234756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24387328-8798-48b4-afa3-743fadf8f3fa None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:31.235339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24387328-8798-48b4-afa3-743fadf8f3fa None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:31.235339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24387328-8798-48b4-afa3-743fadf8f3fa None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:31.236827 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 372/744] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:31.241917 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103a155-1cf8-4702-9629-0257e58eb479 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:31.242353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103a155-1cf8-4702-9629-0257e58eb479 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:31.242522 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7103a155-1cf8-4702-9629-0257e58eb479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:31.260142 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-7103a155-1cf8-4702-9629-0257e58eb479 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:31.261375 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-7103a155-1cf8-4702-9629-0257e58eb479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:31.334868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 373/745] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:31 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:50:31.359836 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24387328-8798-48b4-afa3-743fadf8f3fa None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:31.406335 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:31.469818 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24387328-8798-48b4-afa3-743fadf8f3fa None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:31.504927 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce16cd-5097-46ee-ad60-e2f52d0cb531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:31.505789 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce16cd-5097-46ee-ad60-e2f52d0cb531 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:31.506076 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce16cd-5097-46ee-ad60-e2f52d0cb531 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:31.506351 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce16cd-5097-46ee-ad60-e2f52d0cb531 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:31.507001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce16cd-5097-46ee-ad60-e2f52d0cb531 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:31.508373 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce16cd-5097-46ee-ad60-e2f52d0cb531 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:31.521054 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-a2ce16cd-5097-46ee-ad60-e2f52d0cb531 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 12:50:31.521054 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:31.521054 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:50:31.521054 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:50:31.521054 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:50:31.521054 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:50:31.521054 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:50:31.521054 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:31.521054 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 12:50:31.521054 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:31.521054 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:31.521054 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:31.521054 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:31.521054 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:31.521054 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:31.521054 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:31.522040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:31.522040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:31.522040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:31.522040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:31.522040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:31.522040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:31.522040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:31.522040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:50:31.522040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:50:31.522040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:50:31.522040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:50:31.522040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:31.522040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:31.522040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:31.522040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:31.522040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:31.522904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:31.522904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:31.522904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:31.522904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:31.522904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:31.522904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:31.522904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:31.522904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:31.522904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:31.522904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:31.522904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:31.522904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:50:31.522904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:31.522904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 12:50:31.522904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:31.522904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 373/746] 10.222.0.40 () {56 vars in 1132 bytes} [Thu Jul 14 12:50:31 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:50:31.527772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c30603-7b23-480c-92c1-17959beb999e None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:31.528069 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c30603-7b23-480c-92c1-17959beb999e None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:31.528355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c30603-7b23-480c-92c1-17959beb999e None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:31.529614 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce16cd-5097-46ee-ad60-e2f52d0cb531 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:31.530047 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 374/747] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:31.535375 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3c49d-d5f6-4574-a0ee-062f1873b670 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:31.535666 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3c49d-d5f6-4574-a0ee-062f1873b670 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:31.535927 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3c49d-d5f6-4574-a0ee-062f1873b670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:31.552913 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-cef3c49d-d5f6-4574-a0ee-062f1873b670 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:31.554116 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-cef3c49d-d5f6-4574-a0ee-062f1873b670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:31.624563 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 375/748] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:31 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 12:50:31.644449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce16cd-5097-46ee-ad60-e2f52d0cb531 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:31.646414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:31.648107 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3c49d-d5f6-4574-a0ee-062f1873b670 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:31.679229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:31.681955 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c07d76-1716-4329-ab5c-a5451efb869b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:31.682904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c07d76-1716-4329-ab5c-a5451efb869b None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:31.683716 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c07d76-1716-4329-ab5c-a5451efb869b None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:31.684004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c07d76-1716-4329-ab5c-a5451efb869b None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:31.684756 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c07d76-1716-4329-ab5c-a5451efb869b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:31.685072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c07d76-1716-4329-ab5c-a5451efb869b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:31.686465 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c07d76-1716-4329-ab5c-a5451efb869b None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:31.692572 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 374/749] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 14 12:50:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:50:31.697987 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c07d76-1716-4329-ab5c-a5451efb869b None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:31.766590 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3c49d-d5f6-4574-a0ee-062f1873b670 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:31.803439 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c07d76-1716-4329-ab5c-a5451efb869b None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:31.804517 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820e25b-3719-4a25-8529-693ae24db52c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:31.805314 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820e25b-3719-4a25-8529-693ae24db52c None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:31.805725 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820e25b-3719-4a25-8529-693ae24db52c None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:31.806008 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0820e25b-3719-4a25-8529-693ae24db52c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:31.837863 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf47155-1cd0-4e6c-bbcb-7b0d863f8865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:31.838479 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf47155-1cd0-4e6c-bbcb-7b0d863f8865 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:31.838763 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf47155-1cd0-4e6c-bbcb-7b0d863f8865 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:31.839043 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf47155-1cd0-4e6c-bbcb-7b0d863f8865 None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:31.839743 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf47155-1cd0-4e6c-bbcb-7b0d863f8865 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:31.840047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf47155-1cd0-4e6c-bbcb-7b0d863f8865 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:31.841488 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf47155-1cd0-4e6c-bbcb-7b0d863f8865 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:31.846914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 375/750] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 14 12:50:31 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:50:31.891627 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820e25b-3719-4a25-8529-693ae24db52c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:31.893173 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0820e25b-3719-4a25-8529-693ae24db52c None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:31.925494 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:32.006303 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 376/751] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:50:31 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 14 12:50:32.007750 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf47155-1cd0-4e6c-bbcb-7b0d863f8865 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:32.044558 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:32.122503 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf47155-1cd0-4e6c-bbcb-7b0d863f8865 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:32.162847 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1fcf58-c9a3-4c36-85cd-f8a349c3cc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:32.163636 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fcf58-c9a3-4c36-85cd-f8a349c3cc7e None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:32.163974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fcf58-c9a3-4c36-85cd-f8a349c3cc7e None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:32.164256 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1fcf58-c9a3-4c36-85cd-f8a349c3cc7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:32.176843 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fcf58-c9a3-4c36-85cd-f8a349c3cc7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:32.178319 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1fcf58-c9a3-4c36-85cd-f8a349c3cc7e None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:32.196886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-0b1fcf58-c9a3-4c36-85cd-f8a349c3cc7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:32.196886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:32.196886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:32.196886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:32.196886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:32.196886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:32.196886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:32.196886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:32.196886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:32.196886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:32.196886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:32.196886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:32.196886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:50:32.196886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:50:32.196886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:50:32.197852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:50:32.197852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:32.197852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:32.197852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:32.197852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:32.197852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:32.197852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:32.197852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:32.197852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:32.197852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:32.197852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:32.197852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:32.197852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:32.197852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:32.197852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:32.197852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:32.197852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:32.198728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:50:32.198728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:50:32.198728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:50:32.198728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:32.198728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 376/752] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:50:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:50:32.204498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820e25b-3719-4a25-8529-693ae24db52c None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:32.249574 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8758b-70d9-43a6-96a0-73cb41939bd7 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:32.250096 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8758b-70d9-43a6-96a0-73cb41939bd7 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:32.250209 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8758b-70d9-43a6-96a0-73cb41939bd7 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:32.251462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 377/753] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:50:32.256526 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e974e2c-4dc1-4c9c-8e16-b35a32efa139 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:32.256782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e974e2c-4dc1-4c9c-8e16-b35a32efa139 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:32.257058 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e974e2c-4dc1-4c9c-8e16-b35a32efa139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:32.273482 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-6e974e2c-4dc1-4c9c-8e16-b35a32efa139 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:32.274662 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-6e974e2c-4dc1-4c9c-8e16-b35a32efa139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:32.316662 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0820e25b-3719-4a25-8529-693ae24db52c None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:32.350320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 378/754] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:32 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 14 12:50:32.352794 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:32.358809 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473ad46-0fe4-4ec9-9a94-3e69d895618b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:32.360003 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473ad46-0fe4-4ec9-9a94-3e69d895618b None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:32.360283 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473ad46-0fe4-4ec9-9a94-3e69d895618b None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:32.360555 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473ad46-0fe4-4ec9-9a94-3e69d895618b None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:32.361348 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473ad46-0fe4-4ec9-9a94-3e69d895618b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:32.361655 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473ad46-0fe4-4ec9-9a94-3e69d895618b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:32.363038 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473ad46-0fe4-4ec9-9a94-3e69d895618b None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:32.374045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e974e2c-4dc1-4c9c-8e16-b35a32efa139 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:32.384909 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 377/755] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:50:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:32.389687 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:32.491592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e974e2c-4dc1-4c9c-8e16-b35a32efa139 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:32.533772 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5980d1b-9315-41e6-9ea4-03a9efed3097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:32.534490 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5980d1b-9315-41e6-9ea4-03a9efed3097 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:32.534770 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5980d1b-9315-41e6-9ea4-03a9efed3097 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:32.535043 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5980d1b-9315-41e6-9ea4-03a9efed3097 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:32.535708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5980d1b-9315-41e6-9ea4-03a9efed3097 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:32.537196 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5980d1b-9315-41e6-9ea4-03a9efed3097 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:32.550133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-a5980d1b-9315-41e6-9ea4-03a9efed3097 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 12:50:32.550133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:32.550133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:50:32.550133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:50:32.550133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:50:32.550133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:50:32.550133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:50:32.550133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:32.550133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 12:50:32.550133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:32.550133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:32.550133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:32.550133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:32.550133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:32.550133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:32.550133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:32.550133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:32.551183 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:32.551183 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:32.551183 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:32.551183 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:32.551183 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:32.551183 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:32.551183 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:50:32.551183 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:50:32.551183 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:50:32.551183 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:50:32.551183 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:32.551183 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:32.551183 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:32.551183 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:32.551183 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:32.551183 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:32.552017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:32.552017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:32.552017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:32.552017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:32.552017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:32.552017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:32.552017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:32.552017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:32.552017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:32.552017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:32.552017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:50:32.552017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:32.552017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 12:50:32.552017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:32.556224 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 379/756] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:50:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:50:32.557732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473ad46-0fe4-4ec9-9a94-3e69d895618b None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:32.669872 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473ad46-0fe4-4ec9-9a94-3e69d895618b None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:32.706405 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dba388-c900-40c0-9680-3c32288dcde0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:32.707068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dba388-c900-40c0-9680-3c32288dcde0 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:32.707350 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dba388-c900-40c0-9680-3c32288dcde0 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:32.707628 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dba388-c900-40c0-9680-3c32288dcde0 None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:32.708331 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dba388-c900-40c0-9680-3c32288dcde0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:32.708659 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dba388-c900-40c0-9680-3c32288dcde0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:32.710299 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dba388-c900-40c0-9680-3c32288dcde0 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:32.715084 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 378/757] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:50:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:32.721249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5980d1b-9315-41e6-9ea4-03a9efed3097 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:32.796972 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:32.818580 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5980d1b-9315-41e6-9ea4-03a9efed3097 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:32.852427 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc8a837-c6cc-46a7-8245-44dde0b21ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:32.853121 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8a837-c6cc-46a7-8245-44dde0b21ef1 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:32.853409 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8a837-c6cc-46a7-8245-44dde0b21ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:32.853690 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc8a837-c6cc-46a7-8245-44dde0b21ef1 None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:32.854397 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8a837-c6cc-46a7-8245-44dde0b21ef1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:32.854705 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8a837-c6cc-46a7-8245-44dde0b21ef1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:32.856081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc8a837-c6cc-46a7-8245-44dde0b21ef1 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:32.860519 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 380/758] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:50:32 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:34.185942 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673c7e4-4650-4698-82b8-d4884f832ed6 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:34.186467 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673c7e4-4650-4698-82b8-d4884f832ed6 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:34.186467 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673c7e4-4650-4698-82b8-d4884f832ed6 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:34.187864 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 379/759] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:34.193172 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341d77b-7944-425b-bced-c0a0d28ad9c1 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:34.193576 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341d77b-7944-425b-bced-c0a0d28ad9c1 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:34.193724 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7341d77b-7944-425b-bced-c0a0d28ad9c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:34.211144 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-7341d77b-7944-425b-bced-c0a0d28ad9c1 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:34.212310 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-7341d77b-7944-425b-bced-c0a0d28ad9c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:34.276488 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 381/760] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:34 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:50:34.300857 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673c7e4-4650-4698-82b8-d4884f832ed6 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:34.357284 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:34.401562 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673c7e4-4650-4698-82b8-d4884f832ed6 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:34.436478 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ee344c-9fc4-4701-bcf9-b1eafb6c420a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:34.437733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee344c-9fc4-4701-bcf9-b1eafb6c420a None admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:34.438014 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee344c-9fc4-4701-bcf9-b1eafb6c420a None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:34.438291 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ee344c-9fc4-4701-bcf9-b1eafb6c420a None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:34.439040 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee344c-9fc4-4701-bcf9-b1eafb6c420a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:34.440433 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ee344c-9fc4-4701-bcf9-b1eafb6c420a None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:34.518908 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 380/761] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 12:50:34 2022] POST /identity/v3/services => generated 269 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:50:35.120346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d355562-4558-4084-95bc-8906eb5a16c4 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:35.120658 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d355562-4558-4084-95bc-8906eb5a16c4 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:35.120953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d355562-4558-4084-95bc-8906eb5a16c4 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:35.122508 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 382/762] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:35.128028 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3949ae0-1a04-4f69-9678-4a33ecdcd5b4 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:35.128324 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3949ae0-1a04-4f69-9678-4a33ecdcd5b4 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:35.128603 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3949ae0-1a04-4f69-9678-4a33ecdcd5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:35.146009 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-a3949ae0-1a04-4f69-9678-4a33ecdcd5b4 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:35.147219 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-a3949ae0-1a04-4f69-9678-4a33ecdcd5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:35.229004 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 381/763] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:35 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:50:35.253382 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d355562-4558-4084-95bc-8906eb5a16c4 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:35.327464 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:35.358120 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d355562-4558-4084-95bc-8906eb5a16c4 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:35.391918 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038fcc01-8d05-4a8a-8f12-314b349c7ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:35.392488 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fcc01-8d05-4a8a-8f12-314b349c7ad2 None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:35.392804 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fcc01-8d05-4a8a-8f12-314b349c7ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:35.393077 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038fcc01-8d05-4a8a-8f12-314b349c7ad2 None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:35.393783 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fcc01-8d05-4a8a-8f12-314b349c7ad2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:35.395154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038fcc01-8d05-4a8a-8f12-314b349c7ad2 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:35.485352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 383/764] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 12:50:35 2022] POST /identity/v3/services => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:50:36.781692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c94d2-4417-45eb-b717-fa74803e57f7 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:36.782228 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c94d2-4417-45eb-b717-fa74803e57f7 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:36.782228 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385c94d2-4417-45eb-b717-fa74803e57f7 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:36.783750 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 382/765] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:36.788933 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bd341-9bd9-4efa-9990-5305b9f2eed2 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:36.789382 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bd341-9bd9-4efa-9990-5305b9f2eed2 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:36.789476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4bd341-9bd9-4efa-9990-5305b9f2eed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:36.805782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-1e4bd341-9bd9-4efa-9990-5305b9f2eed2 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:36.806964 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-1e4bd341-9bd9-4efa-9990-5305b9f2eed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:36.877590 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 384/766] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:36 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:50:36.902096 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c94d2-4417-45eb-b717-fa74803e57f7 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:36.943593 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:37.000403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385c94d2-4417-45eb-b717-fa74803e57f7 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:37.033620 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231da8c-8528-49dc-bff5-a9b5717eff75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:37.034344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231da8c-8528-49dc-bff5-a9b5717eff75 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:37.034624 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231da8c-8528-49dc-bff5-a9b5717eff75 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:37.034899 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231da8c-8528-49dc-bff5-a9b5717eff75 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:37.035545 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231da8c-8528-49dc-bff5-a9b5717eff75 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:37.036973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7231da8c-8528-49dc-bff5-a9b5717eff75 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:37.048797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-7231da8c-8528-49dc-bff5-a9b5717eff75 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 12:50:37.048797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:37.048797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:50:37.048797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:50:37.048797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:50:37.048797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:50:37.048797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:50:37.048797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:37.048797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 12:50:37.048797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:37.048797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:37.048797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:37.048797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:37.048797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:37.048797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:37.048797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:37.050044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:37.050044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:37.050044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:37.050044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:37.050044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:37.050044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:37.050044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:37.050044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:50:37.050044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:50:37.050044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:50:37.050044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:50:37.050044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:37.050044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:37.050044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:37.050044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:37.050044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:37.050887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:37.050887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:37.050887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:37.050887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:37.050887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:37.050887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:37.050887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:37.050887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:37.050887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:37.050887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:37.050887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:37.050887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:50:37.050887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:37.050887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 12:50:37.050887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:37.050887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 383/767] 10.222.0.40 () {56 vars in 1132 bytes} [Thu Jul 14 12:50:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:37.056038 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bd341-9bd9-4efa-9990-5305b9f2eed2 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:37.113937 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:37.158446 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4bd341-9bd9-4efa-9990-5305b9f2eed2 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:37.197745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c2b2b-de83-4edd-82be-e806cf33b4f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:37.198409 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c2b2b-de83-4edd-82be-e806cf33b4f7 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:37.198698 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c2b2b-de83-4edd-82be-e806cf33b4f7 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:37.198976 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803c2b2b-de83-4edd-82be-e806cf33b4f7 None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:37.199692 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c2b2b-de83-4edd-82be-e806cf33b4f7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:37.199999 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c2b2b-de83-4edd-82be-e806cf33b4f7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:37.201415 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803c2b2b-de83-4edd-82be-e806cf33b4f7 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:37.206223 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 385/768] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 14 12:50:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:37.212284 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231da8c-8528-49dc-bff5-a9b5717eff75 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:37.317179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231da8c-8528-49dc-bff5-a9b5717eff75 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:37.319401 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:37.349818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ec2d6-c00a-4b83-b7f4-8e02c2e48c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:37.350473 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ec2d6-c00a-4b83-b7f4-8e02c2e48c45 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:37.350754 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ec2d6-c00a-4b83-b7f4-8e02c2e48c45 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:37.351027 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ec2d6-c00a-4b83-b7f4-8e02c2e48c45 None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:37.351723 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ec2d6-c00a-4b83-b7f4-8e02c2e48c45 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:37.352026 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ec2d6-c00a-4b83-b7f4-8e02c2e48c45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:37.353406 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3ec2d6-c00a-4b83-b7f4-8e02c2e48c45 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:37.358149 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 384/769] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 14 12:50:37 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:37.364624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c2b2b-de83-4edd-82be-e806cf33b4f7 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:37.466791 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803c2b2b-de83-4edd-82be-e806cf33b4f7 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:37.487786 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:37.501378 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c19bb5-879b-4c97-8433-1db22ce1e623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:37.501989 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c19bb5-879b-4c97-8433-1db22ce1e623 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:37.502271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c19bb5-879b-4c97-8433-1db22ce1e623 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:37.502550 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c19bb5-879b-4c97-8433-1db22ce1e623 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:37.503351 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c19bb5-879b-4c97-8433-1db22ce1e623 None admin] RBAC: Adding query filter params (interface=public, service_id=58ad0aad8ff44e37859b1642081f5c46, region_id=RegionOne) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:37.503659 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c19bb5-879b-4c97-8433-1db22ce1e623 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:37.505087 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c19bb5-879b-4c97-8433-1db22ce1e623 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:37.510249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 386/770] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 14 12:50:37 2022] GET /identity/v3/endpoints?service_id=58ad0aad8ff44e37859b1642081f5c46&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:37.515895 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ec2d6-c00a-4b83-b7f4-8e02c2e48c45 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:37.620794 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3ec2d6-c00a-4b83-b7f4-8e02c2e48c45 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:37.655480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb32c7e-954d-49ae-a00f-3fb3a9a64857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:37.656706 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb32c7e-954d-49ae-a00f-3fb3a9a64857 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:37.656997 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb32c7e-954d-49ae-a00f-3fb3a9a64857 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:37.657274 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb32c7e-954d-49ae-a00f-3fb3a9a64857 None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:37.657956 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb32c7e-954d-49ae-a00f-3fb3a9a64857 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:37.659324 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb32c7e-954d-49ae-a00f-3fb3a9a64857 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:37.665258 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 385/771] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 14 12:50:37 2022] GET /identity/v3/services => generated 1498 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:50:37.741396 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6728e-8c50-4266-9e12-f921e0cb241f None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:37.741895 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6728e-8c50-4266-9e12-f921e0cb241f None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:37.742180 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b6728e-8c50-4266-9e12-f921e0cb241f None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:37.743594 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 387/772] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:37.749512 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5c8f1-04f1-47b4-8156-641e973c6fd6 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:37.749807 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5c8f1-04f1-47b4-8156-641e973c6fd6 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:37.750110 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e5c8f1-04f1-47b4-8156-641e973c6fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:37.768113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-a8e5c8f1-04f1-47b4-8156-641e973c6fd6 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:37.769389 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-a8e5c8f1-04f1-47b4-8156-641e973c6fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:37.798786 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:37.844007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 386/773] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:37 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:50:37.867664 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6728e-8c50-4266-9e12-f921e0cb241f None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:37.970063 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b6728e-8c50-4266-9e12-f921e0cb241f None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:38.002776 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbe86f-b172-41f8-98d7-bb151612d6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:38.003566 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbe86f-b172-41f8-98d7-bb151612d6e1 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:38.003842 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbe86f-b172-41f8-98d7-bb151612d6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:38.004113 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fbe86f-b172-41f8-98d7-bb151612d6e1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:38.004831 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbe86f-b172-41f8-98d7-bb151612d6e1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:38.006191 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fbe86f-b172-41f8-98d7-bb151612d6e1 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:38.018363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-a9fbe86f-b172-41f8-98d7-bb151612d6e1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 12:50:38.018363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:38.018363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:50:38.018363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:50:38.018363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:50:38.018363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:50:38.018363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:50:38.018363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:38.018363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 12:50:38.018363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:38.018363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:38.018363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:38.018363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:38.018363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:38.018363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:38.018363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:38.018363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:38.019477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:38.019477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:38.019477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:38.019477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:38.019477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:38.019477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:38.019477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:50:38.019477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:50:38.019477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:50:38.019477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:50:38.019477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:38.019477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:38.019477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:38.019477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:38.019477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:38.019477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:38.020328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:38.020328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:38.020328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:38.020328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:38.020328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:38.020328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:38.020328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:38.020328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:38.020328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:38.020328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:38.020328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:50:38.020328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:38.020328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 12:50:38.020328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:38.020328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 388/774] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:50:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:38.025440 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5c8f1-04f1-47b4-8156-641e973c6fd6 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:38.133140 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e5c8f1-04f1-47b4-8156-641e973c6fd6 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:38.286275 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cb250-7b65-46e7-a908-83d0f71fd37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:38.286940 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cb250-7b65-46e7-a908-83d0f71fd37e None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:38.287224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cb250-7b65-46e7-a908-83d0f71fd37e None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:38.287598 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2cb250-7b65-46e7-a908-83d0f71fd37e None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:38.288204 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cb250-7b65-46e7-a908-83d0f71fd37e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:38.288513 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cb250-7b65-46e7-a908-83d0f71fd37e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:38.289944 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2cb250-7b65-46e7-a908-83d0f71fd37e None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:38.294786 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 387/775] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:50:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:38.300451 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbe86f-b172-41f8-98d7-bb151612d6e1 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:38.350307 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:38.401885 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fbe86f-b172-41f8-98d7-bb151612d6e1 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:38.438396 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbea7f3-ba32-499f-bc17-c3988936aeca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:38.439062 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbea7f3-ba32-499f-bc17-c3988936aeca None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:38.439348 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbea7f3-ba32-499f-bc17-c3988936aeca None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:38.439630 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbea7f3-ba32-499f-bc17-c3988936aeca None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:38.440349 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbea7f3-ba32-499f-bc17-c3988936aeca None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:38.440699 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbea7f3-ba32-499f-bc17-c3988936aeca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:38.442089 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbea7f3-ba32-499f-bc17-c3988936aeca None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:38.447341 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 389/776] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:50:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:38.453418 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cb250-7b65-46e7-a908-83d0f71fd37e None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:38.481385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:38.550673 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2cb250-7b65-46e7-a908-83d0f71fd37e None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:38.582494 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f52cf95-7b3a-4a9e-bab3-c16918f71d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:38.583135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52cf95-7b3a-4a9e-bab3-c16918f71d30 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:38.583428 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52cf95-7b3a-4a9e-bab3-c16918f71d30 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:38.583682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f52cf95-7b3a-4a9e-bab3-c16918f71d30 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:38.584740 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52cf95-7b3a-4a9e-bab3-c16918f71d30 None admin] RBAC: Adding query filter params (interface=public, service_id=ee2c0978cb684eba98fe9803fcc431bd, region_id=RegionOne) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:38.585044 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52cf95-7b3a-4a9e-bab3-c16918f71d30 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:38.586391 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f52cf95-7b3a-4a9e-bab3-c16918f71d30 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:38.591286 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 388/777] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 14 12:50:38 2022] GET /identity/v3/endpoints?service_id=ee2c0978cb684eba98fe9803fcc431bd&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:38.597520 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbea7f3-ba32-499f-bc17-c3988936aeca None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:38.695842 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbea7f3-ba32-499f-bc17-c3988936aeca None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:38.709294 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:38.730396 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11a5967-3eea-4d94-8582-1e096032229f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:38.731053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a5967-3eea-4d94-8582-1e096032229f None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:38.731338 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a5967-3eea-4d94-8582-1e096032229f None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:38.731616 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11a5967-3eea-4d94-8582-1e096032229f None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:38.732293 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a5967-3eea-4d94-8582-1e096032229f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:38.733706 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11a5967-3eea-4d94-8582-1e096032229f None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:38.740129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 390/778] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 14 12:50:38 2022] GET /identity/v3/services => generated 1498 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:50:39.926503 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3853da-3438-4c3c-b9a2-2e7c73a036e4 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:39.927042 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3853da-3438-4c3c-b9a2-2e7c73a036e4 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:39.927042 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3853da-3438-4c3c-b9a2-2e7c73a036e4 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:39.928410 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 389/779] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:39.933681 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0616157-d2e1-4a36-a6fd-8bd0d1a277ce None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:39.934132 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0616157-d2e1-4a36-a6fd-8bd0d1a277ce None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:39.934241 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0616157-d2e1-4a36-a6fd-8bd0d1a277ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:39.951294 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-c0616157-d2e1-4a36-a6fd-8bd0d1a277ce None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:39.953487 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-c0616157-d2e1-4a36-a6fd-8bd0d1a277ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:40.021103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 391/780] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:39 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:50:40.045545 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3853da-3438-4c3c-b9a2-2e7c73a036e4 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:40.141170 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:40.149210 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3853da-3438-4c3c-b9a2-2e7c73a036e4 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:40.183278 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda334b-22f4-4b7f-814c-4c15804f4264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:40.184007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda334b-22f4-4b7f-814c-4c15804f4264 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:40.184289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda334b-22f4-4b7f-814c-4c15804f4264 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:40.184563 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda334b-22f4-4b7f-814c-4c15804f4264 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:40.185242 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda334b-22f4-4b7f-814c-4c15804f4264 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:40.186596 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda334b-22f4-4b7f-814c-4c15804f4264 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:40.199261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-abda334b-22f4-4b7f-814c-4c15804f4264 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 12:50:40.199261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:40.199261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:50:40.199261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:50:40.199261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:50:40.199261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:50:40.199261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:50:40.199261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:40.199261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 12:50:40.199261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:40.199261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:40.199261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:40.199261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:40.199261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:40.199261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:40.199261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:40.200464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:40.200464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:40.200464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:40.200464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:40.200464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:40.200464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:40.200464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:40.200464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:50:40.200464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:50:40.200464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:50:40.200464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:50:40.200464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:40.200464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:40.200464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:40.200464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:40.200464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:40.201481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:40.201481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:40.201481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:40.201481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:40.201481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:40.201481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:40.201481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:40.201481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:40.201481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:40.201481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:40.201481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:40.201481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:50:40.201481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:40.201481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 14 12:50:40.201481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:40.201481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 390/781] 10.222.0.40 () {56 vars in 1132 bytes} [Thu Jul 14 12:50:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:40.206465 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0616157-d2e1-4a36-a6fd-8bd0d1a277ce None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:40.302766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0616157-d2e1-4a36-a6fd-8bd0d1a277ce None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:40.309964 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:40.339443 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c478d3-8bd1-485b-9a4a-9a4ae67a3e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:40.340096 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c478d3-8bd1-485b-9a4a-9a4ae67a3e28 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:40.340377 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c478d3-8bd1-485b-9a4a-9a4ae67a3e28 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:40.340672 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c478d3-8bd1-485b-9a4a-9a4ae67a3e28 None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:40.341372 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c478d3-8bd1-485b-9a4a-9a4ae67a3e28 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:40.341675 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c478d3-8bd1-485b-9a4a-9a4ae67a3e28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:40.343069 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c478d3-8bd1-485b-9a4a-9a4ae67a3e28 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:40.352577 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 392/782] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 14 12:50:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:40.353805 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda334b-22f4-4b7f-814c-4c15804f4264 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:40.452939 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda334b-22f4-4b7f-814c-4c15804f4264 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:40.487737 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76909e8c-4b4f-4921-a9da-6830db3f8e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:40.488397 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76909e8c-4b4f-4921-a9da-6830db3f8e6e None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:40.488712 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76909e8c-4b4f-4921-a9da-6830db3f8e6e None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:40.488991 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76909e8c-4b4f-4921-a9da-6830db3f8e6e None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:40.489694 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76909e8c-4b4f-4921-a9da-6830db3f8e6e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:40.490001 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76909e8c-4b4f-4921-a9da-6830db3f8e6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:40.491359 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76909e8c-4b4f-4921-a9da-6830db3f8e6e None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:40.496966 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 391/783] 10.222.0.40 () {56 vars in 1126 bytes} [Thu Jul 14 12:50:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:40.502648 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c478d3-8bd1-485b-9a4a-9a4ae67a3e28 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:40.601421 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c478d3-8bd1-485b-9a4a-9a4ae67a3e28 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:40.634516 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c688be14-3848-47a5-b9be-360a0066cd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:40.635171 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688be14-3848-47a5-b9be-360a0066cd27 None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:40.635455 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688be14-3848-47a5-b9be-360a0066cd27 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:40.635729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c688be14-3848-47a5-b9be-360a0066cd27 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:40.636481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688be14-3848-47a5-b9be-360a0066cd27 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:40.637904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c688be14-3848-47a5-b9be-360a0066cd27 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:40.720005 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 393/784] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 14 12:50:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:50:41.010352 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964062f-b280-4688-bfce-c6aadd241525 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:41.010897 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964062f-b280-4688-bfce-c6aadd241525 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:41.010897 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6964062f-b280-4688-bfce-c6aadd241525 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:41.012259 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 392/785] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:41.017613 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dac646-2e69-47da-909b-60a8132d9acc None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:41.018033 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dac646-2e69-47da-909b-60a8132d9acc None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:41.018260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dac646-2e69-47da-909b-60a8132d9acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:41.034967 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-a5dac646-2e69-47da-909b-60a8132d9acc None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:41.036159 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-a5dac646-2e69-47da-909b-60a8132d9acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:41.061134 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:41.114457 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 394/786] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:41 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:50:41.138368 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964062f-b280-4688-bfce-c6aadd241525 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:41.158824 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:41.242200 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6964062f-b280-4688-bfce-c6aadd241525 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:41.281296 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84c0a7-5619-4a89-9fdc-7b8bc3446ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:41.282001 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84c0a7-5619-4a89-9fdc-7b8bc3446ce3 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:41.282277 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84c0a7-5619-4a89-9fdc-7b8bc3446ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:41.282546 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e84c0a7-5619-4a89-9fdc-7b8bc3446ce3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:41.283183 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84c0a7-5619-4a89-9fdc-7b8bc3446ce3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:41.284534 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e84c0a7-5619-4a89-9fdc-7b8bc3446ce3 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:41.303649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-7e84c0a7-5619-4a89-9fdc-7b8bc3446ce3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 12:50:41.303649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:41.303649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:50:41.303649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:50:41.303649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:50:41.303649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:50:41.303649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:50:41.303649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:41.303649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 12:50:41.303649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:41.303649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:41.303649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:41.303649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:41.303649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:41.303649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:41.303649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:41.303649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:41.304937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:41.304937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:41.304937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:41.304937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:41.304937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:41.304937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:41.304937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:50:41.304937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:50:41.304937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:50:41.304937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:50:41.304937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:41.304937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:41.304937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:41.304937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:41.304937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:41.304937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:41.306079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:41.306079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:41.306079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:41.306079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:41.306079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:41.306079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:41.306079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:41.306079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:41.306079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:41.306079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:41.306079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:50:41.306079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:41.306079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 14 12:50:41.306079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:41.308803 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 393/787] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:50:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:41.310741 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dac646-2e69-47da-909b-60a8132d9acc None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:41.407740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dac646-2e69-47da-909b-60a8132d9acc None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:41.441561 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b095f4-5a64-47fd-8dcf-9e92e292bc28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:41.442226 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b095f4-5a64-47fd-8dcf-9e92e292bc28 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:41.442514 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b095f4-5a64-47fd-8dcf-9e92e292bc28 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:41.442792 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b095f4-5a64-47fd-8dcf-9e92e292bc28 None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:41.443502 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b095f4-5a64-47fd-8dcf-9e92e292bc28 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:41.443814 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b095f4-5a64-47fd-8dcf-9e92e292bc28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:41.445234 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b095f4-5a64-47fd-8dcf-9e92e292bc28 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:41.449910 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 395/788] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:50:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:41.455862 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84c0a7-5619-4a89-9fdc-7b8bc3446ce3 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:41.539271 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:41.556332 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e84c0a7-5619-4a89-9fdc-7b8bc3446ce3 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:41.590100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc3cd47-f64c-47bd-b476-3240cc5f2fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:41.590758 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3cd47-f64c-47bd-b476-3240cc5f2fc1 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:41.591046 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3cd47-f64c-47bd-b476-3240cc5f2fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:41.591326 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc3cd47-f64c-47bd-b476-3240cc5f2fc1 None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:41.592030 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3cd47-f64c-47bd-b476-3240cc5f2fc1 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:41.592333 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3cd47-f64c-47bd-b476-3240cc5f2fc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:41.593768 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc3cd47-f64c-47bd-b476-3240cc5f2fc1 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:41.598523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 394/789] 10.222.0.40 () {56 vars in 1114 bytes} [Thu Jul 14 12:50:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:41.605364 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b095f4-5a64-47fd-8dcf-9e92e292bc28 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:41.622581 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:41.703334 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b095f4-5a64-47fd-8dcf-9e92e292bc28 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:41.736944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cf8971-db7b-4da0-9117-9ad9a987dd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:41.737594 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf8971-db7b-4da0-9117-9ad9a987dd96 None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:41.737881 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf8971-db7b-4da0-9117-9ad9a987dd96 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:41.738159 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cf8971-db7b-4da0-9117-9ad9a987dd96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:41.738913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf8971-db7b-4da0-9117-9ad9a987dd96 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:41.740293 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cf8971-db7b-4da0-9117-9ad9a987dd96 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:41.862086 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 396/790] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 14 12:50:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:50:43.021563 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5692e8-0e72-4d60-a544-42bbeefaa176 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:43.022135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5692e8-0e72-4d60-a544-42bbeefaa176 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:43.022135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5692e8-0e72-4d60-a544-42bbeefaa176 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:43.023452 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 395/791] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:43.028812 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda560c-ff82-4f9e-8743-edc97b79a7a5 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:43.029246 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda560c-ff82-4f9e-8743-edc97b79a7a5 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:43.029438 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deda560c-ff82-4f9e-8743-edc97b79a7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:43.046156 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-deda560c-ff82-4f9e-8743-edc97b79a7a5 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:43.047366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-deda560c-ff82-4f9e-8743-edc97b79a7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:43.115075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:43.121294 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 397/792] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:43 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:50:43.146183 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5692e8-0e72-4d60-a544-42bbeefaa176 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:43.257264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5692e8-0e72-4d60-a544-42bbeefaa176 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:43.289623 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad63b23-2407-46b0-8ef4-4c19839cd902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:43.290337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad63b23-2407-46b0-8ef4-4c19839cd902 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:43.290622 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad63b23-2407-46b0-8ef4-4c19839cd902 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:43.290899 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad63b23-2407-46b0-8ef4-4c19839cd902 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:43.291539 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad63b23-2407-46b0-8ef4-4c19839cd902 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:43.292930 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad63b23-2407-46b0-8ef4-4c19839cd902 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:43.304973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-5ad63b23-2407-46b0-8ef4-4c19839cd902 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 12:50:43.304973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:43.304973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:50:43.304973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:50:43.304973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:50:43.304973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:50:43.304973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:50:43.304973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:43.304973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 12:50:43.304973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:43.304973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:43.304973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:43.304973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:43.304973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:43.304973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:43.304973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:43.304973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:43.306229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:43.306229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:43.306229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:43.306229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:43.306229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:43.306229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:43.306229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:50:43.306229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:50:43.306229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:50:43.306229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:50:43.306229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:43.306229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:43.306229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:43.306229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:43.306229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:43.306229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:43.307081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:43.307081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:43.307081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:43.307081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:43.307081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:43.307081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:43.307081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:43.307081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:43.307081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:43.307081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:43.307081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:50:43.307081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:43.307081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 12:50:43.307081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:43.307081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 396/793] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:43.312694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda560c-ff82-4f9e-8743-edc97b79a7a5 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:43.409116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deda560c-ff82-4f9e-8743-edc97b79a7a5 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:43.443791 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf08763-699e-48d4-972e-4899166bab26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:43.444453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf08763-699e-48d4-972e-4899166bab26 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:43.444776 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf08763-699e-48d4-972e-4899166bab26 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:43.445060 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf08763-699e-48d4-972e-4899166bab26 None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:43.445777 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf08763-699e-48d4-972e-4899166bab26 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:43.446090 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf08763-699e-48d4-972e-4899166bab26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:43.447469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf08763-699e-48d4-972e-4899166bab26 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:43.452292 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 398/794] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 12:50:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:43.458066 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad63b23-2407-46b0-8ef4-4c19839cd902 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:43.471535 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:43.570399 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad63b23-2407-46b0-8ef4-4c19839cd902 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:43.604113 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0922519-9244-4932-9d8c-61a1c007b6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:43.604806 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0922519-9244-4932-9d8c-61a1c007b6c0 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:43.605092 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0922519-9244-4932-9d8c-61a1c007b6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:43.605368 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0922519-9244-4932-9d8c-61a1c007b6c0 None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:43.606067 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0922519-9244-4932-9d8c-61a1c007b6c0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:43.606372 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0922519-9244-4932-9d8c-61a1c007b6c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:43.607751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0922519-9244-4932-9d8c-61a1c007b6c0 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:43.613171 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 397/795] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 12:50:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:44.129522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caac7b8-38c8-4006-9f6e-10b1e9035afa None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:44.130075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caac7b8-38c8-4006-9f6e-10b1e9035afa None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:44.130075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caac7b8-38c8-4006-9f6e-10b1e9035afa None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:44.131562 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 399/796] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:44.136824 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577dab9-dfc5-4f2a-bc47-f23e226c14a7 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:44.137256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577dab9-dfc5-4f2a-bc47-f23e226c14a7 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:44.137413 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1577dab9-dfc5-4f2a-bc47-f23e226c14a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:44.154315 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-1577dab9-dfc5-4f2a-bc47-f23e226c14a7 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:44.155488 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-1577dab9-dfc5-4f2a-bc47-f23e226c14a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:44.223122 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 398/797] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:44 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:50:44.247381 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caac7b8-38c8-4006-9f6e-10b1e9035afa None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:44.309611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:44.349445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caac7b8-38c8-4006-9f6e-10b1e9035afa None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:44.384904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f33f0-e1cf-41b1-94e9-56bc8d6817c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:44.385485 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f33f0-e1cf-41b1-94e9-56bc8d6817c1 None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:44.385772 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f33f0-e1cf-41b1-94e9-56bc8d6817c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:44.386053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f33f0-e1cf-41b1-94e9-56bc8d6817c1 None admin] PATH_INFO: `/v3/projects` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:44.386757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f33f0-e1cf-41b1-94e9-56bc8d6817c1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:44.388203 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f33f0-e1cf-41b1-94e9-56bc8d6817c1 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:44.389612 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: WARNING keystone.server.flask.common [None req-7b2f33f0-e1cf-41b1-94e9-56bc8d6817c1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 14 12:50:44.449851 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.sql.core [None req-7b2f33f0-e1cf-41b1-94e9-56bc8d6817c1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 12:50:44.449851 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 12:50:44.449851 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [parameters: {'id': '6e1a2e8c5f8c40c6bc6cecd7c96c0147', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 12:50:44.449851 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87245) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 12:50:44.474399 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-7b2f33f0-e1cf-41b1-94e9-56bc8d6817c1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6e1a2e8c5f8c40c6bc6cecd7c96c0147.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6e1a2e8c5f8c40c6bc6cecd7c96c0147. Jul 14 12:50:44.474399 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:44.474399 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 12:50:44.474399 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 12:50:44.474399 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 12:50:44.474399 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 12:50:44.474399 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 12:50:44.474399 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 12:50:44.474399 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 12:50:44.474399 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application conn.query(q) Jul 14 12:50:44.474399 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 12:50:44.474399 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 12:50:44.474399 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 12:50:44.475322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application result.read() Jul 14 12:50:44.475322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 12:50:44.475322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 12:50:44.475322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 12:50:44.475322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 12:50:44.475322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 12:50:44.475322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 12:50:44.475322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 12:50:44.475322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 12:50:44.475322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 12:50:44.475322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:44.475322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 12:50:44.475322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:44.475322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:44.475322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 12:50:44.475322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 12:50:44.475322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 14 12:50:44.475322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 14 12:50:44.476309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 12:50:44.476309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application next(self.gen) Jul 14 12:50:44.476309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 12:50:44.476309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application yield resource Jul 14 12:50:44.476309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 12:50:44.476309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application next(self.gen) Jul 14 12:50:44.476309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 12:50:44.476309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 12:50:44.476309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 12:50:44.476309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 12:50:44.476309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 12:50:44.476309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise self.value Jul 14 12:50:44.476309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 12:50:44.476309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 12:50:44.476309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 12:50:44.476309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application session.commit() Jul 14 12:50:44.476309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 12:50:44.477249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 12:50:44.477249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 12:50:44.477249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 12:50:44.477249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 12:50:44.477249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self.session.flush() Jul 14 12:50:44.477249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 12:50:44.477249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 12:50:44.477249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 12:50:44.477249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 12:50:44.477249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 12:50:44.477249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application compat.raise_( Jul 14 12:50:44.477249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 12:50:44.477249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception Jul 14 12:50:44.477249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 12:50:44.477249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 12:50:44.477249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 12:50:44.477249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 12:50:44.478160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 12:50:44.478160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 12:50:44.478160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 12:50:44.478160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 12:50:44.478160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 14 12:50:44.478160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 14 12:50:44.478160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 12:50:44.478160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 12:50:44.478160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 12:50:44.478160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 12:50:44.478160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 12:50:44.478160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 12:50:44.478160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 12:50:44.478160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 12:50:44.478160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 12:50:44.479001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 12:50:44.479001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 12:50:44.479001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception Jul 14 12:50:44.479001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 12:50:44.479001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 12:50:44.479001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 12:50:44.479001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 12:50:44.479001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 12:50:44.479001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 12:50:44.479001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 12:50:44.479001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application conn.query(q) Jul 14 12:50:44.479001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 12:50:44.479001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 12:50:44.479001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 12:50:44.479001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application result.read() Jul 14 12:50:44.479001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 12:50:44.479001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 12:50:44.479894 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 12:50:44.479894 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 12:50:44.479894 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 12:50:44.479894 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 12:50:44.479894 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 12:50:44.479894 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 12:50:44.479894 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 14 12:50:44.479894 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 14 12:50:44.479894 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [parameters: {'id': '6e1a2e8c5f8c40c6bc6cecd7c96c0147', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 14 12:50:44.479894 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 12:50:44.479894 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:44.479894 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:44.479894 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:44.479894 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:44.479894 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 14 12:50:44.481940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 14 12:50:44.481940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 12:50:44.481940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 12:50:44.481940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 14 12:50:44.481940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:44.481940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:44.481940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:44.481940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:44.481940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:44.481940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:44.481940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:44.481940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:44.481940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:44.481940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:44.481940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:44.481940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:44.481940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:44.483981 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:44.483981 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 14 12:50:44.483981 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 14 12:50:44.483981 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:44.483981 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:44.483981 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 14 12:50:44.483981 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 14 12:50:44.483981 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 6e1a2e8c5f8c40c6bc6cecd7c96c0147. Jul 14 12:50:44.483981 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:44.483981 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 400/798] 10.222.0.40 () {60 vars in 1140 bytes} [Thu Jul 14 12:50:44 2022] POST /identity/v3/projects => generated 262 bytes in 229 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:44.484776 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577dab9-dfc5-4f2a-bc47-f23e226c14a7 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:44.486718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:44.578859 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1577dab9-dfc5-4f2a-bc47-f23e226c14a7 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:44.612324 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef6ea4b-8825-45fa-92fb-de8a3be5ae5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:44.613146 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6ea4b-8825-45fa-92fb-de8a3be5ae5d None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:44.613430 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6ea4b-8825-45fa-92fb-de8a3be5ae5d None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:44.613702 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef6ea4b-8825-45fa-92fb-de8a3be5ae5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:44.620461 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6ea4b-8825-45fa-92fb-de8a3be5ae5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:44.621933 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef6ea4b-8825-45fa-92fb-de8a3be5ae5d None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:44.635905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-aef6ea4b-8825-45fa-92fb-de8a3be5ae5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:44.635905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:44.635905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:44.635905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:44.635905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:44.635905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:44.635905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:44.635905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:44.635905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:44.635905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:44.635905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:44.635905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:44.635905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:50:44.635905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:50:44.635905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:50:44.636825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:50:44.636825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:44.636825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:44.636825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:44.636825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:44.636825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:44.636825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:44.636825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:44.636825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:44.636825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:44.636825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:44.636825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:44.636825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:44.636825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:44.636825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:44.636825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:44.636825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:44.637732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:50:44.637732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:50:44.637732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:50:44.637732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:50:44.637732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:50:44.637732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:50:44.637732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:50:44.637732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:44.637732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 399/799] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:44.643185 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f33f0-e1cf-41b1-94e9-56bc8d6817c1 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:44.744234 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f33f0-e1cf-41b1-94e9-56bc8d6817c1 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:44.763402 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:44.779829 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f16332-070e-44a8-8028-ab8e0300e9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:44.780486 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f16332-070e-44a8-8028-ab8e0300e9f4 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:44.780836 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f16332-070e-44a8-8028-ab8e0300e9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:44.781114 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f16332-070e-44a8-8028-ab8e0300e9f4 None admin] PATH_INFO: `/v3/projects` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:44.781868 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f16332-070e-44a8-8028-ab8e0300e9f4 None admin] RBAC: Adding query filter params (name=service) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:44.782176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f16332-070e-44a8-8028-ab8e0300e9f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:44.783810 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f16332-070e-44a8-8028-ab8e0300e9f4 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:44.804568 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 401/800] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 12:50:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:45.863370 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab59f8-4457-40c6-9325-7963ba6c2be2 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:45.863908 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab59f8-4457-40c6-9325-7963ba6c2be2 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:45.864103 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ab59f8-4457-40c6-9325-7963ba6c2be2 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:45.865454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 400/801] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:45.870910 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0db417-f010-43a7-b01b-5629995c0f72 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:45.871381 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0db417-f010-43a7-b01b-5629995c0f72 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:45.871473 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0db417-f010-43a7-b01b-5629995c0f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:45.891290 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-5f0db417-f010-43a7-b01b-5629995c0f72 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:45.892813 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-5f0db417-f010-43a7-b01b-5629995c0f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:45.959963 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 402/802] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:45 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:50:45.984916 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab59f8-4457-40c6-9325-7963ba6c2be2 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:46.050643 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:46.090552 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ab59f8-4457-40c6-9325-7963ba6c2be2 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:46.123590 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4fd677-d13a-490e-98d1-ae017b65935f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:46.124161 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fd677-d13a-490e-98d1-ae017b65935f None admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:46.124443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fd677-d13a-490e-98d1-ae017b65935f None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:46.124749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4fd677-d13a-490e-98d1-ae017b65935f None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:46.125454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fd677-d13a-490e-98d1-ae017b65935f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:46.126805 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4fd677-d13a-490e-98d1-ae017b65935f None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:46.199392 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 401/803] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 12:50:45 2022] POST /identity/v3/services => generated 242 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:50:47.098384 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329397b2-dab6-4614-a9c4-c5942807e963 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:47.098924 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329397b2-dab6-4614-a9c4-c5942807e963 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:47.098924 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329397b2-dab6-4614-a9c4-c5942807e963 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:47.100287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 403/804] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:47.105425 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0811b02-710d-4674-bf75-6c48cc24fa42 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:47.105938 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0811b02-710d-4674-bf75-6c48cc24fa42 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:47.106027 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0811b02-710d-4674-bf75-6c48cc24fa42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:47.122768 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-c0811b02-710d-4674-bf75-6c48cc24fa42 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:47.123943 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-c0811b02-710d-4674-bf75-6c48cc24fa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:47.205688 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 402/805] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:47 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:50:47.232399 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329397b2-dab6-4614-a9c4-c5942807e963 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:47.334220 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329397b2-dab6-4614-a9c4-c5942807e963 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:47.345759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:47.372919 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903b3b6-859a-4016-be39-8fa92975ba37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:47.373510 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903b3b6-859a-4016-be39-8fa92975ba37 None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:47.373801 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903b3b6-859a-4016-be39-8fa92975ba37 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:47.374076 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b903b3b6-859a-4016-be39-8fa92975ba37 None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:47.374820 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903b3b6-859a-4016-be39-8fa92975ba37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:47.376260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b903b3b6-859a-4016-be39-8fa92975ba37 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:47.455950 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.sql.core [None req-b903b3b6-859a-4016-be39-8fa92975ba37 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 12:50:47.455950 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 12:50:47.455950 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [parameters: {'user_id': '702a502bc15541d6bf8dece6a8f93884', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 12:50:47.455950 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87245) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 14 12:50:47.463646 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-b903b3b6-859a-4016-be39-8fa92975ba37 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 12:50:47.463646 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:47.463646 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 12:50:47.463646 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 12:50:47.463646 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 12:50:47.463646 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 12:50:47.463646 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 12:50:47.463646 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 12:50:47.463646 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 12:50:47.463646 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application conn.query(q) Jul 14 12:50:47.463646 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 12:50:47.463646 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 12:50:47.463646 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 12:50:47.463646 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application result.read() Jul 14 12:50:47.463646 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 12:50:47.471259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 12:50:47.471259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 12:50:47.471259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 12:50:47.471259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 12:50:47.471259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 12:50:47.471259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 12:50:47.471259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 12:50:47.471259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 12:50:47.471259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:47.471259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 14 12:50:47.471259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:47.471259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:47.471259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 14 12:50:47.471259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 14 12:50:47.471259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 14 12:50:47.471259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 14 12:50:47.471259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 12:50:47.471259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application next(self.gen) Jul 14 12:50:47.472204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 14 12:50:47.472204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application yield resource Jul 14 12:50:47.472204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 14 12:50:47.472204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application next(self.gen) Jul 14 12:50:47.472204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 14 12:50:47.472204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self.session.rollback() Jul 14 12:50:47.472204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 14 12:50:47.472204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self.force_reraise() Jul 14 12:50:47.472204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 14 12:50:47.472204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise self.value Jul 14 12:50:47.472204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 14 12:50:47.472204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 14 12:50:47.472204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 14 12:50:47.472204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application session.commit() Jul 14 12:50:47.472204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 14 12:50:47.472204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 14 12:50:47.472204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 14 12:50:47.473129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._prepare_impl() Jul 14 12:50:47.473129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 14 12:50:47.473129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self.session.flush() Jul 14 12:50:47.473129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 14 12:50:47.473129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._flush(objects) Jul 14 12:50:47.473129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 14 12:50:47.473129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 14 12:50:47.473129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 14 12:50:47.473129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application compat.raise_( Jul 14 12:50:47.473129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 12:50:47.473129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception Jul 14 12:50:47.473129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 14 12:50:47.473129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application flush_context.execute() Jul 14 12:50:47.473129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 14 12:50:47.473129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rec.execute(self) Jul 14 12:50:47.473129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 14 12:50:47.473129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 14 12:50:47.474031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 14 12:50:47.474031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 14 12:50:47.474031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 14 12:50:47.474031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 14 12:50:47.474031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 14 12:50:47.474031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 14 12:50:47.474031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 14 12:50:47.474031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 14 12:50:47.474031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 14 12:50:47.474031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 14 12:50:47.474031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 14 12:50:47.474031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 14 12:50:47.474031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 14 12:50:47.474031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 14 12:50:47.474031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 14 12:50:47.474031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception Jul 14 12:50:47.474920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 14 12:50:47.474920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 14 12:50:47.474920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 14 12:50:47.474920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 14 12:50:47.474920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 14 12:50:47.474920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application result = self._query(query) Jul 14 12:50:47.474920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 14 12:50:47.474920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application conn.query(q) Jul 14 12:50:47.474920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 14 12:50:47.474920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 14 12:50:47.474920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 14 12:50:47.474920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application result.read() Jul 14 12:50:47.474920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 14 12:50:47.474920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 14 12:50:47.474920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 14 12:50:47.474920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 14 12:50:47.475740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 14 12:50:47.475740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 14 12:50:47.475740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 14 12:50:47.475740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 14 12:50:47.475740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 14 12:50:47.475740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 14 12:50:47.475740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [parameters: {'user_id': '702a502bc15541d6bf8dece6a8f93884', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 14 12:50:47.475740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 14 12:50:47.475740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:47.475740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:47.475740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:47.475740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:47.475740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:47.475740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:47.475740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:47.476522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:47.476522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:47.476522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:47.476522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:47.476522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:47.476522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:47.476522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:47.476522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 14 12:50:47.476522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 14 12:50:47.476522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:47.476522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:47.476522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:50:47.476522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:47.476522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:50:47.476522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:47.476522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 14 12:50:47.476522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 14 12:50:47.477728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 14 12:50:47.477728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 14 12:50:47.477728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 14 12:50:47.477728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 14 12:50:47.477728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 14 12:50:47.477728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:47.477728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 404/806] 10.222.0.40 () {60 vars in 1131 bytes} [Thu Jul 14 12:50:47 2022] POST /identity/v3/users => generated 160 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:47.478108 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0811b02-710d-4674-bf75-6c48cc24fa42 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:47.522047 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:47.570975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0811b02-710d-4674-bf75-6c48cc24fa42 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:47.605347 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdbbf09-8649-44e4-b8c9-97211af22310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:47.606138 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbbf09-8649-44e4-b8c9-97211af22310 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:47.606414 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbbf09-8649-44e4-b8c9-97211af22310 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:47.606682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdbbf09-8649-44e4-b8c9-97211af22310 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:47.613592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbbf09-8649-44e4-b8c9-97211af22310 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:47.615011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdbbf09-8649-44e4-b8c9-97211af22310 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:47.629458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-4fdbbf09-8649-44e4-b8c9-97211af22310 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 12:50:47.629458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:47.629458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:47.629458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:47.629458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:47.629458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:47.629458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:47.629458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:47.629458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:47.629458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:47.629458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:47.629458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:47.629458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:50:47.629458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:50:47.629458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:50:47.629458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:50:47.630614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:47.630614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:47.630614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:50:47.630614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:47.630614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:50:47.630614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:50:47.630614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:47.630614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:47.630614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:47.630614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:47.630614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:47.630614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:47.630614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:47.630614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:47.630614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:47.630614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:47.630614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:47.630614 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:47.631732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:47.631732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:47.631732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:50:47.631732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:50:47.631732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:50:47.631732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:50:47.631732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:50:47.631732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:50:47.631732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 14 12:50:47.631732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:47.631732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 403/807] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:50:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:50:47.636762 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903b3b6-859a-4016-be39-8fa92975ba37 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:47.739008 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b903b3b6-859a-4016-be39-8fa92975ba37 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:47.772076 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c65e3-182f-43d5-af30-b7cafce3fe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:47.772771 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c65e3-182f-43d5-af30-b7cafce3fe1b None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:47.773052 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c65e3-182f-43d5-af30-b7cafce3fe1b None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:47.773328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c65e3-182f-43d5-af30-b7cafce3fe1b None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:47.774135 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c65e3-182f-43d5-af30-b7cafce3fe1b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:47.774471 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c65e3-182f-43d5-af30-b7cafce3fe1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:47.776105 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21c65e3-182f-43d5-af30-b7cafce3fe1b None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:47.815228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 405/808] 10.222.0.40 () {56 vars in 1101 bytes} [Thu Jul 14 12:50:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:50:48.457676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac88176-7e00-4a51-89de-2b51b92ebc89 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:48.458229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac88176-7e00-4a51-89de-2b51b92ebc89 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:48.458229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac88176-7e00-4a51-89de-2b51b92ebc89 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:48.459768 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 404/809] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:48.465132 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a446a-18f9-40ef-9aa4-af38d3e53cae None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:48.465585 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a446a-18f9-40ef-9aa4-af38d3e53cae None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:48.465682 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a446a-18f9-40ef-9aa4-af38d3e53cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:48.482290 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-896a446a-18f9-40ef-9aa4-af38d3e53cae None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:48.484302 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-896a446a-18f9-40ef-9aa4-af38d3e53cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:48.507979 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:48.549832 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 406/810] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:48 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:50:48.574653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac88176-7e00-4a51-89de-2b51b92ebc89 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:48.673817 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac88176-7e00-4a51-89de-2b51b92ebc89 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:48.684827 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:48.708624 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f3e3a-7a08-4db2-941f-099fd7ad4bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:48.709377 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f3e3a-7a08-4db2-941f-099fd7ad4bcf None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:48.709912 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f3e3a-7a08-4db2-941f-099fd7ad4bcf None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:48.710190 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0f3e3a-7a08-4db2-941f-099fd7ad4bcf None admin] PATH_INFO: `/v3/services/compute` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:48.710836 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f3e3a-7a08-4db2-941f-099fd7ad4bcf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:48.712279 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0f3e3a-7a08-4db2-941f-099fd7ad4bcf None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:48.723687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-fa0f3e3a-7a08-4db2-941f-099fd7ad4bcf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 12:50:48.723687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:48.723687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:50:48.723687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:50:48.723687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:50:48.723687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:50:48.723687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:50:48.723687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:48.723687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 12:50:48.723687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:48.723687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:48.723687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:48.723687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:48.723687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:48.723687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:48.723687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:48.723687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:48.725016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:48.725016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:48.725016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:48.725016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:48.725016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:48.725016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:48.725016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:50:48.725016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:50:48.725016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:50:48.725016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:50:48.725016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:48.725016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:48.725016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:48.725016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:48.725016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:48.725016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:48.726002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:48.726002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:48.726002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:48.726002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:48.726002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:48.726002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:48.726002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:48.726002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:48.726002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:48.726002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:48.726002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:50:48.726002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:48.726002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 12:50:48.726002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:50:48.726002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 405/811] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:48.730947 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a446a-18f9-40ef-9aa4-af38d3e53cae None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:48.827772 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a446a-18f9-40ef-9aa4-af38d3e53cae None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:48.861221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6d0cd-b203-4f2a-bc14-3f712ee9ee35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:48.861882 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6d0cd-b203-4f2a-bc14-3f712ee9ee35 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:48.862174 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6d0cd-b203-4f2a-bc14-3f712ee9ee35 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:48.862450 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c6d0cd-b203-4f2a-bc14-3f712ee9ee35 None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:48.863161 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6d0cd-b203-4f2a-bc14-3f712ee9ee35 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:48.863471 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6d0cd-b203-4f2a-bc14-3f712ee9ee35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:48.864876 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c6d0cd-b203-4f2a-bc14-3f712ee9ee35 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:48.869663 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 407/812] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 12:50:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:48.875892 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f3e3a-7a08-4db2-941f-099fd7ad4bcf None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:48.973635 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0f3e3a-7a08-4db2-941f-099fd7ad4bcf None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:49.006733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ae517-0d43-49ea-bb6a-7283ced4228c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:49.007387 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ae517-0d43-49ea-bb6a-7283ced4228c None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:49.007670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ae517-0d43-49ea-bb6a-7283ced4228c None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:49.007945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5ae517-0d43-49ea-bb6a-7283ced4228c None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:49.008652 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ae517-0d43-49ea-bb6a-7283ced4228c None admin] RBAC: Adding query filter params (type=compute) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:49.009935 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ae517-0d43-49ea-bb6a-7283ced4228c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:49.010312 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5ae517-0d43-49ea-bb6a-7283ced4228c None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:49.014965 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 406/813] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 12:50:48 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:49.021654 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6d0cd-b203-4f2a-bc14-3f712ee9ee35 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:49.045949 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:49.118936 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c6d0cd-b203-4f2a-bc14-3f712ee9ee35 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:49.152998 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36ffb0f-f04a-4250-afb6-8d718209d9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:49.153651 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ffb0f-f04a-4250-afb6-8d718209d9ec None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:49.153931 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ffb0f-f04a-4250-afb6-8d718209d9ec None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:49.154204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36ffb0f-f04a-4250-afb6-8d718209d9ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:49.154973 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ffb0f-f04a-4250-afb6-8d718209d9ec None admin] RBAC: Adding query filter params (interface=public, service_id=aef916fd79ae4db39014c5e7b63905d8, region_id=RegionOne) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:49.155278 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ffb0f-f04a-4250-afb6-8d718209d9ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:49.156630 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36ffb0f-f04a-4250-afb6-8d718209d9ec None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:49.161589 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 408/814] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 14 12:50:49 2022] GET /identity/v3/endpoints?service_id=aef916fd79ae4db39014c5e7b63905d8&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:49.167233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ae517-0d43-49ea-bb6a-7283ced4228c None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:49.206757 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:49.266122 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5ae517-0d43-49ea-bb6a-7283ced4228c None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:49.298196 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766b319-fddc-4224-9ce1-4c35167e5a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:49.298841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766b319-fddc-4224-9ce1-4c35167e5a65 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:49.299119 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766b319-fddc-4224-9ce1-4c35167e5a65 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:49.299391 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766b319-fddc-4224-9ce1-4c35167e5a65 None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:49.300081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766b319-fddc-4224-9ce1-4c35167e5a65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:49.301445 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766b319-fddc-4224-9ce1-4c35167e5a65 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:49.307492 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 407/815] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 14 12:50:49 2022] GET /identity/v3/services => generated 1728 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:50:51.538117 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3c2c5-c4fe-4bfa-a1b7-4d72b1784829 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:51.538651 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3c2c5-c4fe-4bfa-a1b7-4d72b1784829 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:51.538765 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d3c2c5-c4fe-4bfa-a1b7-4d72b1784829 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:51.540038 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 409/816] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:50:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:50:51.545115 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5d44f-09b9-4185-a3f9-3bb5fb35018b None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:51.545516 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5d44f-09b9-4185-a3f9-3bb5fb35018b None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:51.545678 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d5d44f-09b9-4185-a3f9-3bb5fb35018b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:51.563293 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-95d5d44f-09b9-4185-a3f9-3bb5fb35018b None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:50:51.564529 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-95d5d44f-09b9-4185-a3f9-3bb5fb35018b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:50:51.629541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 408/817] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:50:51 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:50:51.654082 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3c2c5-c4fe-4bfa-a1b7-4d72b1784829 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:51.739954 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:51.754872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d3c2c5-c4fe-4bfa-a1b7-4d72b1784829 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:51.787898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befbeb0-6765-4892-b6f0-ab05566e9f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:51.788755 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befbeb0-6765-4892-b6f0-ab05566e9f8d None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:51.788996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befbeb0-6765-4892-b6f0-ab05566e9f8d None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:51.789273 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befbeb0-6765-4892-b6f0-ab05566e9f8d None admin] PATH_INFO: `/v3/services/compute` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:51.789923 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befbeb0-6765-4892-b6f0-ab05566e9f8d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:51.791294 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befbeb0-6765-4892-b6f0-ab05566e9f8d None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:51.803374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-9befbeb0-6765-4892-b6f0-ab05566e9f8d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 12:50:51.803374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:51.803374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:50:51.803374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:50:51.803374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:50:51.803374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:50:51.803374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:50:51.803374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:51.803374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 12:50:51.803374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:51.803374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:50:51.803374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:51.803374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:50:51.803374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:50:51.803374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:50:51.803374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:50:51.803374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:50:51.804548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:50:51.804548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:50:51.804548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:50:51.804548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:50:51.804548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:50:51.804548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:50:51.804548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:50:51.804548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:50:51.804548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:50:51.804548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:50:51.804548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:50:51.804548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:50:51.804548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:50:51.804548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:50:51.804548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:50:51.804548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:50:51.805476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:50:51.805476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:50:51.805476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:50:51.805476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:50:51.805476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:50:51.805476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:50:51.805476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:50:51.805476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:50:51.805476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:50:51.805476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:50:51.805476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:50:51.805476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:50:51.805476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 14 12:50:51.805476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:50:51.805476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 410/818] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:50:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:50:51.810574 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5d44f-09b9-4185-a3f9-3bb5fb35018b None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:51.840100 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:51.906174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d5d44f-09b9-4185-a3f9-3bb5fb35018b None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:51.938971 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e30747-0177-4ef8-bbd7-a95d7a1d5d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:51.939628 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e30747-0177-4ef8-bbd7-a95d7a1d5d92 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:51.939906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e30747-0177-4ef8-bbd7-a95d7a1d5d92 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:51.940178 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e30747-0177-4ef8-bbd7-a95d7a1d5d92 None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:51.940953 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e30747-0177-4ef8-bbd7-a95d7a1d5d92 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:51.941259 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e30747-0177-4ef8-bbd7-a95d7a1d5d92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:51.942612 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e30747-0177-4ef8-bbd7-a95d7a1d5d92 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:51.947239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 409/819] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 12:50:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:51.953041 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befbeb0-6765-4892-b6f0-ab05566e9f8d None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:52.050334 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befbeb0-6765-4892-b6f0-ab05566e9f8d None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:52.083042 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ae7cd6-b424-47ff-a1f0-65f7c9d83f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:52.083728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae7cd6-b424-47ff-a1f0-65f7c9d83f7d None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:52.084013 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae7cd6-b424-47ff-a1f0-65f7c9d83f7d None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:52.084289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ae7cd6-b424-47ff-a1f0-65f7c9d83f7d None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:52.085288 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae7cd6-b424-47ff-a1f0-65f7c9d83f7d None admin] RBAC: Adding query filter params (type=compute) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:50:52.085598 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae7cd6-b424-47ff-a1f0-65f7c9d83f7d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:52.086983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ae7cd6-b424-47ff-a1f0-65f7c9d83f7d None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:52.092326 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 411/820] 10.222.0.40 () {56 vars in 1112 bytes} [Thu Jul 14 12:50:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:50:52.098812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e30747-0177-4ef8-bbd7-a95d7a1d5d92 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:50:52.190205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:50:52.195841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e30747-0177-4ef8-bbd7-a95d7a1d5d92 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:50:52.230223 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a56234-f5d3-4441-8f94-9afa2d68f419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:50:52.230868 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a56234-f5d3-4441-8f94-9afa2d68f419 None admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:50:52.231149 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a56234-f5d3-4441-8f94-9afa2d68f419 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:50:52.231424 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a56234-f5d3-4441-8f94-9afa2d68f419 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:50:52.232156 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a56234-f5d3-4441-8f94-9afa2d68f419 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:50:52.233553 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a56234-f5d3-4441-8f94-9afa2d68f419 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:50:52.312623 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 410/821] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 14 12:50:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:51:02.089441 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=93 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:51:02.308207 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=23,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:17.450632 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde3a2c-1b45-4fe6-afe6-d70599e39123 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:17.451214 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde3a2c-1b45-4fe6-afe6-d70599e39123 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:17.451214 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdde3a2c-1b45-4fe6-afe6-d70599e39123 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:17.452530 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 412/822] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:52:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:52:17.458084 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fd5ab-d7a7-4627-bb7f-d9289760fc6f None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:17.458610 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fd5ab-d7a7-4627-bb7f-d9289760fc6f None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:17.458721 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110fd5ab-d7a7-4627-bb7f-d9289760fc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:17.475891 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-110fd5ab-d7a7-4627-bb7f-d9289760fc6f None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:52:17.477123 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-110fd5ab-d7a7-4627-bb7f-d9289760fc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:52:17.547816 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 411/823] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:52:17 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:52:17.574272 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde3a2c-1b45-4fe6-afe6-d70599e39123 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:17.676995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdde3a2c-1b45-4fe6-afe6-d70599e39123 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:17.711688 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e181a-dcd2-4dc6-9031-688e7bce0f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:17.712386 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e181a-dcd2-4dc6-9031-688e7bce0f3b None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:17.712698 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e181a-dcd2-4dc6-9031-688e7bce0f3b None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:17.712980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4e181a-dcd2-4dc6-9031-688e7bce0f3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:17.724784 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e181a-dcd2-4dc6-9031-688e7bce0f3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:17.726253 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4e181a-dcd2-4dc6-9031-688e7bce0f3b None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:17.742995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-fe4e181a-dcd2-4dc6-9031-688e7bce0f3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:17.742995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:17.742995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:17.742995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:17.742995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:17.742995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:17.742995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:17.742995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:17.742995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:17.742995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:17.742995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:17.742995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:17.742995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:52:17.742995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:52:17.742995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:52:17.744157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:52:17.744157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:17.744157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:17.744157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:17.744157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:17.744157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:17.744157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:17.744157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:17.744157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:17.744157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:17.744157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:17.744157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:17.744157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:17.744157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:17.744157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:17.744157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:17.744157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:17.745506 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:52:17.745506 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:52:17.745506 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:17.745506 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:52:17.745506 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 413/824] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:17.750355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fd5ab-d7a7-4627-bb7f-d9289760fc6f None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:17.849789 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110fd5ab-d7a7-4627-bb7f-d9289760fc6f None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:17.874217 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:17.883642 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e100f9-8fcd-494d-887e-21fdbcf142b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:17.884594 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e100f9-8fcd-494d-887e-21fdbcf142b9 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:17.885054 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e100f9-8fcd-494d-887e-21fdbcf142b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:17.885465 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e100f9-8fcd-494d-887e-21fdbcf142b9 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:17.886560 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e100f9-8fcd-494d-887e-21fdbcf142b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:17.887041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e100f9-8fcd-494d-887e-21fdbcf142b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:17.889376 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e100f9-8fcd-494d-887e-21fdbcf142b9 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:17.905901 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 412/825] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:17.912481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e181a-dcd2-4dc6-9031-688e7bce0f3b None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:17.978972 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:18.026469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4e181a-dcd2-4dc6-9031-688e7bce0f3b None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:18.059488 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb600389-e8c6-4e7a-8e7b-37b31205bc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:18.062272 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb600389-e8c6-4e7a-8e7b-37b31205bc00 None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:18.062272 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb600389-e8c6-4e7a-8e7b-37b31205bc00 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:18.062272 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb600389-e8c6-4e7a-8e7b-37b31205bc00 None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:18.062272 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb600389-e8c6-4e7a-8e7b-37b31205bc00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:18.062996 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb600389-e8c6-4e7a-8e7b-37b31205bc00 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:18.178138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 414/826] 10.222.0.40 () {60 vars in 1132 bytes} [Thu Jul 14 12:52:17 2022] POST /identity/v3/users => generated 251 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:52:20.480940 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ea157-0a7f-4be7-bb5c-99d48689c0e6 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:20.481563 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ea157-0a7f-4be7-bb5c-99d48689c0e6 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:20.481563 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ea157-0a7f-4be7-bb5c-99d48689c0e6 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:20.482768 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 413/827] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:52:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:52:20.488602 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96e064-5478-4254-93e8-7b8eaf1c9155 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:20.489204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96e064-5478-4254-93e8-7b8eaf1c9155 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:20.489204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e96e064-5478-4254-93e8-7b8eaf1c9155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:20.505959 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-3e96e064-5478-4254-93e8-7b8eaf1c9155 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:52:20.507176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-3e96e064-5478-4254-93e8-7b8eaf1c9155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:52:20.572489 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 415/828] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:52:20 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:52:20.599077 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ea157-0a7f-4be7-bb5c-99d48689c0e6 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:20.702483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ea157-0a7f-4be7-bb5c-99d48689c0e6 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:20.735806 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e3195-7327-489c-ac4a-b0a58784b93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:20.736531 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e3195-7327-489c-ac4a-b0a58784b93d None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:20.740902 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e3195-7327-489c-ac4a-b0a58784b93d None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:20.740902 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991e3195-7327-489c-ac4a-b0a58784b93d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:20.747438 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991e3195-7327-489c-ac4a-b0a58784b93d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:52:20.755152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-991e3195-7327-489c-ac4a-b0a58784b93d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:52:20.755152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:20.755152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:20.755152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:20.755152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:20.755152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:20.755152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:20.755152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:20.755152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:20.755152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:20.755152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:20.755152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:20.755152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:52:20.755152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:52:20.755152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:52:20.755152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:52:20.756442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:52:20.756442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:52:20.756442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:52:20.756442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:52:20.756442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:20.756442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:20.756442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:20.756442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:20.756442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:20.756442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:20.756442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:20.756442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:20.756442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:20.756442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:20.756442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:20.756442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:20.757592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:20.757592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:20.757592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:20.757592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:20.757592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:52:20.757592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:52:20.757592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:52:20.757592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:52:20.757592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:52:20.757592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:52:20.757592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:52:20.757592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:20.757592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 414/829] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 12:52:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:20.762589 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96e064-5478-4254-93e8-7b8eaf1c9155 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:20.802662 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:20.859790 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e96e064-5478-4254-93e8-7b8eaf1c9155 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:20.893758 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bab45-9bf3-41cb-952a-ded1123fa931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:20.894417 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bab45-9bf3-41cb-952a-ded1123fa931 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:20.894700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bab45-9bf3-41cb-952a-ded1123fa931 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:20.894973 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3bab45-9bf3-41cb-952a-ded1123fa931 None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:20.895714 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bab45-9bf3-41cb-952a-ded1123fa931 None admin] RBAC: Adding query filter params (name=service) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:20.896021 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bab45-9bf3-41cb-952a-ded1123fa931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:20.897469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3bab45-9bf3-41cb-952a-ded1123fa931 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:20.905275 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 416/830] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 12:52:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:20.911933 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e3195-7327-489c-ac4a-b0a58784b93d None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:20.960074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:21.011411 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991e3195-7327-489c-ac4a-b0a58784b93d None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:21.045974 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26986430-83ab-4ed0-acc8-966558c75509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:21.046798 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26986430-83ab-4ed0-acc8-966558c75509 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:21.047088 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26986430-83ab-4ed0-acc8-966558c75509 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:21.047366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26986430-83ab-4ed0-acc8-966558c75509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:21.057321 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26986430-83ab-4ed0-acc8-966558c75509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:21.058761 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26986430-83ab-4ed0-acc8-966558c75509 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:21.076233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-26986430-83ab-4ed0-acc8-966558c75509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:21.076233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:21.076233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:21.076233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:21.076233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:21.076233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:21.076233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:21.076233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:21.076233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:21.076233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:21.076233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:21.076233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:21.076233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:52:21.076233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:52:21.076233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:52:21.077302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:52:21.077302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:21.077302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:21.077302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:21.077302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:21.077302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:21.077302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:21.077302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:21.077302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:21.077302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:21.077302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:21.077302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:21.077302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:21.077302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:21.077302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:21.077302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:21.077302 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:21.078375 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:52:21.078375 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:52:21.078375 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:21.078375 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:21.078375 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 415/831] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:21.084280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bab45-9bf3-41cb-952a-ded1123fa931 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:21.186872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:21.190354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3bab45-9bf3-41cb-952a-ded1123fa931 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:21.223004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00836a-6e53-4381-877e-7ebcac5d61b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:21.223660 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00836a-6e53-4381-877e-7ebcac5d61b4 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:21.223948 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00836a-6e53-4381-877e-7ebcac5d61b4 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:21.224225 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00836a-6e53-4381-877e-7ebcac5d61b4 None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:21.224975 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00836a-6e53-4381-877e-7ebcac5d61b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:21.225296 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00836a-6e53-4381-877e-7ebcac5d61b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:21.226661 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00836a-6e53-4381-877e-7ebcac5d61b4 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:21.238409 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 417/832] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:21.244957 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26986430-83ab-4ed0-acc8-966558c75509 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:21.343046 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:21.346057 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26986430-83ab-4ed0-acc8-966558c75509 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:21.379536 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d7d84-e187-4369-9092-52cf3b7aded2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:21.380336 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d7d84-e187-4369-9092-52cf3b7aded2 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:21.380625 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d7d84-e187-4369-9092-52cf3b7aded2 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:21.380926 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d7d84-e187-4369-9092-52cf3b7aded2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:21.387842 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d7d84-e187-4369-9092-52cf3b7aded2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:21.389315 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5d7d84-e187-4369-9092-52cf3b7aded2 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:21.403658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-ed5d7d84-e187-4369-9092-52cf3b7aded2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 12:52:21.403658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:21.403658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:21.403658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:21.403658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:21.403658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:21.403658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:21.403658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:21.403658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:21.403658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:21.403658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:21.403658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:21.403658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:52:21.403658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:52:21.403658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:52:21.403658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:52:21.404841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:21.404841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:21.404841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:52:21.404841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:52:21.404841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:52:21.404841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:52:21.404841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:21.404841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:21.404841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:21.404841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:21.404841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:21.404841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:21.404841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:21.404841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:21.404841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:21.404841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:21.404841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:21.404841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:21.405989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:21.405989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:21.405989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:52:21.405989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:52:21.405989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:52:21.405989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:52:21.405989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:52:21.405989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:52:21.405989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 12:52:21.405989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:21.405989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 416/833] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:21.410901 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00836a-6e53-4381-877e-7ebcac5d61b4 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:21.515280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00836a-6e53-4381-877e-7ebcac5d61b4 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:21.548906 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b09aff-46c6-4b33-8fe4-2b75a791c5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:21.549573 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b09aff-46c6-4b33-8fe4-2b75a791c5c8 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:21.549860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b09aff-46c6-4b33-8fe4-2b75a791c5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:21.550141 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b09aff-46c6-4b33-8fe4-2b75a791c5c8 None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:21.550999 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b09aff-46c6-4b33-8fe4-2b75a791c5c8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:21.551314 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b09aff-46c6-4b33-8fe4-2b75a791c5c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:21.552771 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b09aff-46c6-4b33-8fe4-2b75a791c5c8 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:21.570295 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 418/834] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jul 14 12:52:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:21.576504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d7d84-e187-4369-9092-52cf3b7aded2 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:21.674299 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5d7d84-e187-4369-9092-52cf3b7aded2 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:21.708220 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6b472-854c-4605-877f-ccdac1f39e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:21.708902 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6b472-854c-4605-877f-ccdac1f39e82 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:21.709201 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6b472-854c-4605-877f-ccdac1f39e82 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:21.709457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec6b472-854c-4605-877f-ccdac1f39e82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:21.735528 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:21.774554 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6b472-854c-4605-877f-ccdac1f39e82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:21.775994 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec6b472-854c-4605-877f-ccdac1f39e82 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:21.870758 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 417/835] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:52:21 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 12:52:21.877074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b09aff-46c6-4b33-8fe4-2b75a791c5c8 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:21.896174 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:21.991260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b09aff-46c6-4b33-8fe4-2b75a791c5c8 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:22.035170 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969dd83-dfca-44da-89b2-fd96ce85062d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:22.035973 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969dd83-dfca-44da-89b2-fd96ce85062d None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:22.036264 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969dd83-dfca-44da-89b2-fd96ce85062d None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:22.036544 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2969dd83-dfca-44da-89b2-fd96ce85062d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:22.046805 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969dd83-dfca-44da-89b2-fd96ce85062d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:22.048825 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2969dd83-dfca-44da-89b2-fd96ce85062d None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:22.066720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-2969dd83-dfca-44da-89b2-fd96ce85062d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:22.066720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:22.066720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:22.066720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:22.066720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:22.066720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:22.066720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:22.066720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:22.066720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:22.066720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:22.066720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:22.066720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:22.066720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:52:22.066720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:52:22.066720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:52:22.067872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:52:22.067872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:22.067872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:22.067872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:22.067872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:22.067872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:22.067872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:22.067872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:22.067872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:22.067872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:22.067872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:22.067872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:22.067872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:22.067872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:22.067872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:22.067872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:22.067872 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:22.069035 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:52:22.069035 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:52:22.069035 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:22.069035 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:52:22.069035 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 419/836] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:22.073630 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6b472-854c-4605-877f-ccdac1f39e82 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:22.129992 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:22.169686 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec6b472-854c-4605-877f-ccdac1f39e82 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:22.204391 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bb09b-2c77-4745-b980-275be80f9808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:22.205139 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bb09b-2c77-4745-b980-275be80f9808 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:22.205631 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bb09b-2c77-4745-b980-275be80f9808 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:22.206075 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8bb09b-2c77-4745-b980-275be80f9808 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:22.207321 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bb09b-2c77-4745-b980-275be80f9808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:22.207620 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bb09b-2c77-4745-b980-275be80f9808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:22.209028 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8bb09b-2c77-4745-b980-275be80f9808 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:22.222408 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 418/837] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:22.228221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969dd83-dfca-44da-89b2-fd96ce85062d None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:22.303825 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:22.347184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2969dd83-dfca-44da-89b2-fd96ce85062d None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:22.384684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02d140-5c0e-4dda-a9a7-788550a0f4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:22.385484 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02d140-5c0e-4dda-a9a7-788550a0f4ee None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:22.385765 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02d140-5c0e-4dda-a9a7-788550a0f4ee None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:22.386048 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc02d140-5c0e-4dda-a9a7-788550a0f4ee None admin] PATH_INFO: `/v3/projects/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:22.392503 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02d140-5c0e-4dda-a9a7-788550a0f4ee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:22.394060 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc02d140-5c0e-4dda-a9a7-788550a0f4ee None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:22.407423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-bc02d140-5c0e-4dda-a9a7-788550a0f4ee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:52:22.407423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:22.407423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:22.407423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:22.407423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:22.407423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:22.407423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:22.407423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:22.407423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:22.407423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:22.407423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:22.407423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:22.407423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:52:22.407423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:52:22.407423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:52:22.409081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:52:22.409081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:22.409081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:22.409081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:22.409081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:22.409081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:22.409081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:22.409081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:22.409081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:22.409081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:22.409081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:22.409081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:22.409081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:22.409081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:22.409081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:22.409081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:22.409081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:22.410002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:52:22.410002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:52:22.410002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:52:22.410002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:52:22.410002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:52:22.410002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:52:22.410002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:52:22.410002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:52:22.410002 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 420/838] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:52:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:22.415210 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bb09b-2c77-4745-b980-275be80f9808 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:22.518466 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8bb09b-2c77-4745-b980-275be80f9808 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:22.535075 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:22.551540 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61de9d4-a964-4867-88b0-ca175e8a408b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:22.552185 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61de9d4-a964-4867-88b0-ca175e8a408b None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:22.552464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61de9d4-a964-4867-88b0-ca175e8a408b None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:22.552780 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61de9d4-a964-4867-88b0-ca175e8a408b None admin] PATH_INFO: `/v3/projects` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:22.553557 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61de9d4-a964-4867-88b0-ca175e8a408b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:22.553916 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61de9d4-a964-4867-88b0-ca175e8a408b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:22.555288 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61de9d4-a964-4867-88b0-ca175e8a408b None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:22.566910 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 419/839] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:52:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:22.574223 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02d140-5c0e-4dda-a9a7-788550a0f4ee None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:22.676672 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc02d140-5c0e-4dda-a9a7-788550a0f4ee None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:22.706781 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:22.713871 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a21ed-a916-4560-b4e1-2c192852565e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:22.714522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a21ed-a916-4560-b4e1-2c192852565e None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:22.714809 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a21ed-a916-4560-b4e1-2c192852565e None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:22.715104 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a21ed-a916-4560-b4e1-2c192852565e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:22.715918 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a21ed-a916-4560-b4e1-2c192852565e None admin] RBAC: Adding query filter params (role.id=f38b25010c404af5bbde51980f7e8dec, scope.project.id=2a58a74d443e40a782112277c58028b6, user.id=ee845fa8cb614ce183d4608e63c3e2d4) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:22.716232 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a21ed-a916-4560-b4e1-2c192852565e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:22.717699 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a21ed-a916-4560-b4e1-2c192852565e None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:22.723198 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 421/840] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:52:22 2022] GET /identity/v3/role_assignments?user.id=ee845fa8cb614ce183d4608e63c3e2d4&scope.project.id=2a58a74d443e40a782112277c58028b6&role.id=f38b25010c404af5bbde51980f7e8dec => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:24.922570 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c6c89-a617-423f-a748-79d7a76752b6 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:24.923141 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c6c89-a617-423f-a748-79d7a76752b6 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:24.923141 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0c6c89-a617-423f-a748-79d7a76752b6 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:24.924516 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 420/841] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:52:24.929930 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbc215-dd73-4bbf-845e-f3a9f42a8a07 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:24.930335 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbc215-dd73-4bbf-845e-f3a9f42a8a07 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:24.930507 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddbc215-dd73-4bbf-845e-f3a9f42a8a07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:24.947763 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-8ddbc215-dd73-4bbf-845e-f3a9f42a8a07 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:52:24.951058 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-8ddbc215-dd73-4bbf-845e-f3a9f42a8a07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:52:25.014777 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 422/842] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:52:24 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:52:25.039127 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c6c89-a617-423f-a748-79d7a76752b6 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:25.141606 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0c6c89-a617-423f-a748-79d7a76752b6 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:25.175531 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa80120-0cfb-47f8-bd6e-419bcc0c92e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:25.176278 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa80120-0cfb-47f8-bd6e-419bcc0c92e7 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:25.176558 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa80120-0cfb-47f8-bd6e-419bcc0c92e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:25.176860 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa80120-0cfb-47f8-bd6e-419bcc0c92e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:25.187573 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa80120-0cfb-47f8-bd6e-419bcc0c92e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:52:25.195869 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-daa80120-0cfb-47f8-bd6e-419bcc0c92e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:52:25.195869 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:25.195869 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:25.195869 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:25.195869 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:25.195869 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:25.195869 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:25.195869 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:25.195869 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:25.195869 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:25.195869 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:25.195869 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:25.195869 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:52:25.195869 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:52:25.195869 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:52:25.195869 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:52:25.197045 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:52:25.197045 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:52:25.197045 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:52:25.197045 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:52:25.197045 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:25.197045 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:25.197045 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:25.197045 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:25.197045 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:25.197045 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:25.197045 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:25.197045 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:25.197045 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:25.197045 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:25.197045 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:25.197045 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:25.198130 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:25.198130 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:25.198130 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:25.198130 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:25.198130 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:52:25.198130 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:52:25.198130 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:52:25.198130 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:52:25.198130 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:52:25.198130 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:52:25.198130 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:52:25.198130 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:25.198130 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 421/843] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 12:52:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:25.203337 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbc215-dd73-4bbf-845e-f3a9f42a8a07 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:25.303366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddbc215-dd73-4bbf-845e-f3a9f42a8a07 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:25.327817 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:25.338739 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963f9b1-f631-4c58-a5d3-2fda8fb4eb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:25.339397 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963f9b1-f631-4c58-a5d3-2fda8fb4eb9e None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:25.339686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963f9b1-f631-4c58-a5d3-2fda8fb4eb9e None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:25.339958 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6963f9b1-f631-4c58-a5d3-2fda8fb4eb9e None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:25.340736 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963f9b1-f631-4c58-a5d3-2fda8fb4eb9e None admin] RBAC: Adding query filter params (name=service) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:25.341046 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963f9b1-f631-4c58-a5d3-2fda8fb4eb9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:25.342552 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6963f9b1-f631-4c58-a5d3-2fda8fb4eb9e None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:25.350474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 423/844] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 12:52:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:25.356244 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa80120-0cfb-47f8-bd6e-419bcc0c92e7 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:25.396879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:25.455012 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa80120-0cfb-47f8-bd6e-419bcc0c92e7 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:25.490828 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68499368-3d24-48da-9521-ca87b36019a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:25.491636 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68499368-3d24-48da-9521-ca87b36019a2 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:25.491919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68499368-3d24-48da-9521-ca87b36019a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:25.492194 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68499368-3d24-48da-9521-ca87b36019a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:25.502558 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68499368-3d24-48da-9521-ca87b36019a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:25.504046 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68499368-3d24-48da-9521-ca87b36019a2 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:25.520507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-68499368-3d24-48da-9521-ca87b36019a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:25.520507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:25.520507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:25.520507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:25.520507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:25.520507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:25.520507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:25.520507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:25.520507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:25.520507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:25.520507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:25.520507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:25.520507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:52:25.520507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:52:25.520507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:52:25.529111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:52:25.529111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:25.529111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:25.529111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:25.529111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:25.529111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:25.529111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:25.529111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:25.529111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:25.529111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:25.529111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:25.529111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:25.529111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:25.529111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:25.529111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:25.529111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:25.529111 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:25.530232 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:52:25.530232 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:52:25.530232 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:25.530232 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:25.530232 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 422/845] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:25.530535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963f9b1-f631-4c58-a5d3-2fda8fb4eb9e None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:25.627422 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6963f9b1-f631-4c58-a5d3-2fda8fb4eb9e None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:25.660016 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b4e23-5daf-40d5-98c5-b5a9dfa2b5c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:25.660681 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b4e23-5daf-40d5-98c5-b5a9dfa2b5c8 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:25.660966 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b4e23-5daf-40d5-98c5-b5a9dfa2b5c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:25.661237 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b4e23-5daf-40d5-98c5-b5a9dfa2b5c8 None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:25.661948 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b4e23-5daf-40d5-98c5-b5a9dfa2b5c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:25.662329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b4e23-5daf-40d5-98c5-b5a9dfa2b5c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:25.666194 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b4e23-5daf-40d5-98c5-b5a9dfa2b5c8 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:25.676046 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 424/846] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:52:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:25.681781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68499368-3d24-48da-9521-ca87b36019a2 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:25.775786 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:25.785616 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68499368-3d24-48da-9521-ca87b36019a2 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:25.819287 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0ec9a-86a2-45d8-baa6-a59f3a41de32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:25.820090 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0ec9a-86a2-45d8-baa6-a59f3a41de32 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:25.820377 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0ec9a-86a2-45d8-baa6-a59f3a41de32 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:25.820678 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f0ec9a-86a2-45d8-baa6-a59f3a41de32 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:25.827898 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0ec9a-86a2-45d8-baa6-a59f3a41de32 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:25.829370 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f0ec9a-86a2-45d8-baa6-a59f3a41de32 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:25.844056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-78f0ec9a-86a2-45d8-baa6-a59f3a41de32 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 12:52:25.844056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:25.844056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:25.844056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:25.844056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:25.844056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:25.844056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:25.844056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:25.844056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:25.844056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:25.844056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:25.844056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:25.844056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:52:25.844056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:52:25.844056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:52:25.844056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:52:25.845866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:25.845866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:25.845866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:52:25.845866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:52:25.845866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:52:25.845866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:52:25.845866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:25.845866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:25.845866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:25.845866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:25.845866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:25.845866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:25.845866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:25.845866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:25.845866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:25.845866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:25.845866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:25.845866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:25.847092 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:25.847092 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:25.847092 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:52:25.847092 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:52:25.847092 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:52:25.847092 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:52:25.847092 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:52:25.847092 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:52:25.847092 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 12:52:25.847092 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:25.847092 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 423/847] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:25.851731 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b4e23-5daf-40d5-98c5-b5a9dfa2b5c8 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:25.899575 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:25.949711 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b4e23-5daf-40d5-98c5-b5a9dfa2b5c8 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:25.983185 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2a78b-c5f7-46b2-91f8-570148502935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:25.983864 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2a78b-c5f7-46b2-91f8-570148502935 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:25.984138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2a78b-c5f7-46b2-91f8-570148502935 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:25.984415 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec2a78b-c5f7-46b2-91f8-570148502935 None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:25.985286 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2a78b-c5f7-46b2-91f8-570148502935 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:25.985601 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2a78b-c5f7-46b2-91f8-570148502935 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:25.987380 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec2a78b-c5f7-46b2-91f8-570148502935 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:26.008156 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 425/848] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jul 14 12:52:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:26.013879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0ec9a-86a2-45d8-baa6-a59f3a41de32 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:26.124626 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f0ec9a-86a2-45d8-baa6-a59f3a41de32 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:26.158853 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae1a36-7f90-4838-9a2b-4b146d1941f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:26.159701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae1a36-7f90-4838-9a2b-4b146d1941f3 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:26.159984 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae1a36-7f90-4838-9a2b-4b146d1941f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:26.160259 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bae1a36-7f90-4838-9a2b-4b146d1941f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:26.170745 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae1a36-7f90-4838-9a2b-4b146d1941f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:26.172174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bae1a36-7f90-4838-9a2b-4b146d1941f3 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:26.189508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-9bae1a36-7f90-4838-9a2b-4b146d1941f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:26.189508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:26.189508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:26.189508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:26.189508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:26.189508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:26.189508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:26.189508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:26.189508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:26.189508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:26.189508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:26.189508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:26.189508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:52:26.189508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:52:26.189508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:52:26.190599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:52:26.190599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:26.190599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:26.190599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:26.190599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:26.190599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:26.190599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:26.190599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:26.190599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:26.190599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:26.190599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:26.190599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:26.190599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:26.190599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:26.190599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:26.190599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:26.190599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:26.191706 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:52:26.191706 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:52:26.191706 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:26.191706 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:26.191706 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 424/849] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:26.196615 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2a78b-c5f7-46b2-91f8-570148502935 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:26.295652 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec2a78b-c5f7-46b2-91f8-570148502935 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:26.297938 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:26.328624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693763e7-bfd6-4b4f-8434-b3e0798854e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:26.329301 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693763e7-bfd6-4b4f-8434-b3e0798854e2 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:26.329618 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693763e7-bfd6-4b4f-8434-b3e0798854e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:26.329893 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693763e7-bfd6-4b4f-8434-b3e0798854e2 None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:26.330612 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693763e7-bfd6-4b4f-8434-b3e0798854e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:26.330918 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693763e7-bfd6-4b4f-8434-b3e0798854e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:26.332285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693763e7-bfd6-4b4f-8434-b3e0798854e2 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:26.343439 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 426/850] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:52:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:26.349605 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae1a36-7f90-4838-9a2b-4b146d1941f3 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:26.352549 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:26.450500 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bae1a36-7f90-4838-9a2b-4b146d1941f3 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:26.484051 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef955de3-0551-41d0-8847-bf90bc3bdc5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:26.484875 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef955de3-0551-41d0-8847-bf90bc3bdc5a None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:26.485165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef955de3-0551-41d0-8847-bf90bc3bdc5a None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:26.485444 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef955de3-0551-41d0-8847-bf90bc3bdc5a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:26.492755 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef955de3-0551-41d0-8847-bf90bc3bdc5a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:26.494200 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef955de3-0551-41d0-8847-bf90bc3bdc5a None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:26.507972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-ef955de3-0551-41d0-8847-bf90bc3bdc5a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:52:26.507972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:26.507972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:26.507972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:26.507972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:26.507972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:26.507972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:26.507972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:26.507972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:26.507972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:26.507972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:26.507972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:26.507972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:52:26.507972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:52:26.507972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:52:26.510464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:52:26.510464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:26.510464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:26.510464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:26.510464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:26.510464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:26.510464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:26.510464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:26.510464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:26.510464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:26.510464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:26.510464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:26.510464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:26.510464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:26.510464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:26.510464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:26.510464 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:26.511607 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:52:26.511607 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:52:26.511607 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:52:26.511607 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:52:26.511607 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:52:26.511607 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:52:26.511607 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:52:26.511607 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:26.511607 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 425/851] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:52:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:26.514988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693763e7-bfd6-4b4f-8434-b3e0798854e2 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:26.613613 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693763e7-bfd6-4b4f-8434-b3e0798854e2 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:26.646792 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188277ee-7695-4241-b91a-20cc6fdeb74c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:26.647439 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188277ee-7695-4241-b91a-20cc6fdeb74c None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:26.647718 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188277ee-7695-4241-b91a-20cc6fdeb74c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:26.647989 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188277ee-7695-4241-b91a-20cc6fdeb74c None admin] PATH_INFO: `/v3/projects` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:26.648799 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188277ee-7695-4241-b91a-20cc6fdeb74c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:26.649108 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188277ee-7695-4241-b91a-20cc6fdeb74c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:26.650536 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188277ee-7695-4241-b91a-20cc6fdeb74c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:26.663139 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 427/852] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:52:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:26.669304 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef955de3-0551-41d0-8847-bf90bc3bdc5a None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:26.730568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:26.767585 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef955de3-0551-41d0-8847-bf90bc3bdc5a None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:26.800907 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa6e66-3db6-40ac-b070-cf58dec114b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:26.801788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa6e66-3db6-40ac-b070-cf58dec114b7 None admin] REQUEST_METHOD: `PUT` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:26.802074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa6e66-3db6-40ac-b070-cf58dec114b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:26.802353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa6e66-3db6-40ac-b070-cf58dec114b7 None admin] PATH_INFO: `/v3/projects/2a58a74d443e40a782112277c58028b6/users/ee845fa8cb614ce183d4608e63c3e2d4/roles/f38b25010c404af5bbde51980f7e8dec` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:26.817337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa6e66-3db6-40ac-b070-cf58dec114b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a58a74d443e40a782112277c58028b6, user_id=ee845fa8cb614ce183d4608e63c3e2d4, role_id=f38b25010c404af5bbde51980f7e8dec)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:26.818784 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa6e66-3db6-40ac-b070-cf58dec114b7 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:26.903637 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 426/853] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 12:52:26 2022] PUT /identity/v3/projects/2a58a74d443e40a782112277c58028b6/users/ee845fa8cb614ce183d4608e63c3e2d4/roles/f38b25010c404af5bbde51980f7e8dec => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:52:29.132582 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d4e28-6df7-4fbe-af5f-3a6469808efb None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:29.132582 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d4e28-6df7-4fbe-af5f-3a6469808efb None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:29.132582 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487d4e28-6df7-4fbe-af5f-3a6469808efb None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:29.133962 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 428/854] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:52:29.139526 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f946c-274f-4c35-a975-e15d0d2d1b5f None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:29.140031 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f946c-274f-4c35-a975-e15d0d2d1b5f None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:29.140130 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f946c-274f-4c35-a975-e15d0d2d1b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:29.157408 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-234f946c-274f-4c35-a975-e15d0d2d1b5f None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:52:29.159265 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-234f946c-274f-4c35-a975-e15d0d2d1b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:52:29.231212 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 427/855] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:52:29 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:52:29.256838 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d4e28-6df7-4fbe-af5f-3a6469808efb None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:29.283008 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:29.359008 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487d4e28-6df7-4fbe-af5f-3a6469808efb None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:29.392958 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e30e91-c7da-4771-b649-b265f9f2bf3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:29.393677 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e30e91-c7da-4771-b649-b265f9f2bf3f None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:29.393972 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e30e91-c7da-4771-b649-b265f9f2bf3f None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:29.394243 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e30e91-c7da-4771-b649-b265f9f2bf3f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:29.404421 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e30e91-c7da-4771-b649-b265f9f2bf3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:52:29.412280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-11e30e91-c7da-4771-b649-b265f9f2bf3f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:52:29.412280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:29.412280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:29.412280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:29.412280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:29.412280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:29.412280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:29.412280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:29.412280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:29.412280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:29.412280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:29.412280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:29.412280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:52:29.412280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:52:29.412280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:52:29.412280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:52:29.413462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:52:29.413462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:52:29.413462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:52:29.413462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:52:29.413462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:29.413462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:29.413462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:29.413462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:29.413462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:29.413462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:29.413462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:29.413462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:29.413462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:29.413462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:29.413462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:29.413462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:29.414606 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:29.414606 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:29.414606 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:29.414606 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:29.414606 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:52:29.414606 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:52:29.414606 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:52:29.414606 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:52:29.414606 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:52:29.414606 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:52:29.414606 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 14 12:52:29.414606 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:52:29.414606 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 429/856] 10.222.0.40 () {56 vars in 1102 bytes} [Thu Jul 14 12:52:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:29.419712 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f946c-274f-4c35-a975-e15d0d2d1b5f None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:29.464031 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:29.518847 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f946c-274f-4c35-a975-e15d0d2d1b5f None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:29.551558 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed87996-f2b6-48e4-8ad0-6d7d1980a400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:29.552218 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed87996-f2b6-48e4-8ad0-6d7d1980a400 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:29.552505 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed87996-f2b6-48e4-8ad0-6d7d1980a400 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:29.552825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed87996-f2b6-48e4-8ad0-6d7d1980a400 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:29.553564 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed87996-f2b6-48e4-8ad0-6d7d1980a400 None admin] RBAC: Adding query filter params (name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:29.553872 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed87996-f2b6-48e4-8ad0-6d7d1980a400 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:29.555266 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed87996-f2b6-48e4-8ad0-6d7d1980a400 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:29.563369 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 428/857] 10.222.0.40 () {56 vars in 1103 bytes} [Thu Jul 14 12:52:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:29.569864 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e30e91-c7da-4771-b649-b265f9f2bf3f None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:29.656100 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:29.671093 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e30e91-c7da-4771-b649-b265f9f2bf3f None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:29.704974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b0151-310d-413a-8555-0d46c430a03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:29.705764 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b0151-310d-413a-8555-0d46c430a03a None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:29.706055 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b0151-310d-413a-8555-0d46c430a03a None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:29.706337 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41b0151-310d-413a-8555-0d46c430a03a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:29.717388 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b0151-310d-413a-8555-0d46c430a03a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:29.718854 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41b0151-310d-413a-8555-0d46c430a03a None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:29.735527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-e41b0151-310d-413a-8555-0d46c430a03a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:29.735527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:29.735527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:29.735527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:29.735527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:29.735527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:29.735527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:29.735527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:29.735527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:29.735527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:29.735527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:29.735527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:29.735527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:52:29.735527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:52:29.735527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:52:29.737138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:52:29.737138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:29.737138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:29.737138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:29.737138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:29.737138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:29.737138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:29.737138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:29.737138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:29.737138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:29.737138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:29.737138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:29.737138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:29.737138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:29.737138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:29.737138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:29.737138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:29.738271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:52:29.738271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:52:29.738271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:29.738271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:52:29.738271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 430/858] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 14 12:52:29.743636 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed87996-f2b6-48e4-8ad0-6d7d1980a400 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:29.852325 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed87996-f2b6-48e4-8ad0-6d7d1980a400 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:29.854620 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:29.886104 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a7fd4-f5b0-40d9-ab38-0448c7de5361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:29.886757 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a7fd4-f5b0-40d9-ab38-0448c7de5361 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:29.887040 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a7fd4-f5b0-40d9-ab38-0448c7de5361 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:29.887315 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94a7fd4-f5b0-40d9-ab38-0448c7de5361 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:29.888024 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a7fd4-f5b0-40d9-ab38-0448c7de5361 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:29.888327 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a7fd4-f5b0-40d9-ab38-0448c7de5361 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:29.889726 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94a7fd4-f5b0-40d9-ab38-0448c7de5361 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:29.900519 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 429/859] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:29.912550 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b0151-310d-413a-8555-0d46c430a03a None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:30.009152 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41b0151-310d-413a-8555-0d46c430a03a None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:30.046620 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4006977-2ab3-4eed-a05a-38ae46781653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:30.047435 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4006977-2ab3-4eed-a05a-38ae46781653 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:30.047720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4006977-2ab3-4eed-a05a-38ae46781653 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:30.047998 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4006977-2ab3-4eed-a05a-38ae46781653 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:30.051473 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:30.056657 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4006977-2ab3-4eed-a05a-38ae46781653 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:30.058122 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4006977-2ab3-4eed-a05a-38ae46781653 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:30.072336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-e4006977-2ab3-4eed-a05a-38ae46781653 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 12:52:30.072336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:30.072336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:30.072336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:30.072336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:30.072336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:30.072336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:30.072336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:30.072336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:30.072336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:30.072336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:30.072336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:30.072336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:52:30.072336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:52:30.072336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:52:30.072336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:52:30.073518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:30.073518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:30.073518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:52:30.073518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:52:30.073518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:52:30.073518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:52:30.073518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:30.073518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:30.073518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:30.073518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:30.073518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:30.073518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:30.073518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:30.073518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:30.073518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:30.073518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:30.073518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:30.073518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:30.074832 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:30.074832 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:30.074832 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:52:30.074832 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:52:30.074832 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:52:30.074832 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:52:30.074832 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:52:30.074832 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:52:30.074832 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 12:52:30.074832 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:52:30.074832 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 431/860] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:29 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:30.082097 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a7fd4-f5b0-40d9-ab38-0448c7de5361 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:30.194413 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94a7fd4-f5b0-40d9-ab38-0448c7de5361 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:30.227748 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02674188-7a1e-4341-a648-8abaf33e7b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:30.228419 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02674188-7a1e-4341-a648-8abaf33e7b6f None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:30.228749 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02674188-7a1e-4341-a648-8abaf33e7b6f None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:30.229063 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02674188-7a1e-4341-a648-8abaf33e7b6f None admin] PATH_INFO: `/v3/users` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:30.229954 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02674188-7a1e-4341-a648-8abaf33e7b6f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:30.230274 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02674188-7a1e-4341-a648-8abaf33e7b6f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:30.231734 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02674188-7a1e-4341-a648-8abaf33e7b6f None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:30.249424 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 430/861] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jul 14 12:52:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:30.255539 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4006977-2ab3-4eed-a05a-38ae46781653 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:30.356857 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4006977-2ab3-4eed-a05a-38ae46781653 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:30.393100 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341b119-6a4b-4b9f-987b-7f7ebdd29990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:30.393748 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341b119-6a4b-4b9f-987b-7f7ebdd29990 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:30.394036 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341b119-6a4b-4b9f-987b-7f7ebdd29990 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:30.394375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341b119-6a4b-4b9f-987b-7f7ebdd29990 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:30.455622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:30.464070 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341b119-6a4b-4b9f-987b-7f7ebdd29990 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:30.465588 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341b119-6a4b-4b9f-987b-7f7ebdd29990 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:30.563430 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 432/862] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:52:30 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 12:52:30.569980 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02674188-7a1e-4341-a648-8abaf33e7b6f None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:30.594786 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:30.669030 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02674188-7a1e-4341-a648-8abaf33e7b6f None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:30.703662 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1660d9-4dd8-45ae-92ee-f88a80cf5f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:30.705132 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1660d9-4dd8-45ae-92ee-f88a80cf5f56 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:30.705422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1660d9-4dd8-45ae-92ee-f88a80cf5f56 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:30.705740 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1660d9-4dd8-45ae-92ee-f88a80cf5f56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:30.716001 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1660d9-4dd8-45ae-92ee-f88a80cf5f56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:30.717527 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1660d9-4dd8-45ae-92ee-f88a80cf5f56 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:30.734759 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-9c1660d9-4dd8-45ae-92ee-f88a80cf5f56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:30.734759 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:30.734759 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:30.734759 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:30.734759 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:30.734759 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:30.734759 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:30.734759 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:30.734759 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:30.734759 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:30.734759 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:30.734759 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:30.734759 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:52:30.734759 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:52:30.734759 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:52:30.735903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:52:30.735903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:30.735903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:30.735903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:30.735903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:30.735903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:30.735903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:30.735903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:30.735903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:30.735903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:30.735903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:30.735903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:30.735903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:30.735903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:30.735903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:30.735903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:30.735903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:30.736879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:52:30.736879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:52:30.736879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:30.736879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:30.736879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 431/863] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:30.741727 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341b119-6a4b-4b9f-987b-7f7ebdd29990 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:30.833692 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:30.839620 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341b119-6a4b-4b9f-987b-7f7ebdd29990 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:30.873929 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65906a8a-f732-475c-a26c-ca1aab393b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:30.874638 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65906a8a-f732-475c-a26c-ca1aab393b97 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:30.874966 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65906a8a-f732-475c-a26c-ca1aab393b97 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:30.875287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65906a8a-f732-475c-a26c-ca1aab393b97 None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:30.876068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65906a8a-f732-475c-a26c-ca1aab393b97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:30.877051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65906a8a-f732-475c-a26c-ca1aab393b97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:30.878530 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65906a8a-f732-475c-a26c-ca1aab393b97 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:30.889865 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 433/864] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:30.896299 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1660d9-4dd8-45ae-92ee-f88a80cf5f56 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:30.970172 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:30.993817 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1660d9-4dd8-45ae-92ee-f88a80cf5f56 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:31.027192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed89717-530b-427b-b352-4f12f58092f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:31.027973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed89717-530b-427b-b352-4f12f58092f0 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:31.028254 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed89717-530b-427b-b352-4f12f58092f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:31.028525 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed89717-530b-427b-b352-4f12f58092f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:31.035171 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed89717-530b-427b-b352-4f12f58092f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:31.036653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed89717-530b-427b-b352-4f12f58092f0 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:31.050719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-5ed89717-530b-427b-b352-4f12f58092f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:52:31.050719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:31.050719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:31.050719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:31.050719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:31.050719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:31.050719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:31.050719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:31.050719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:31.050719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:31.050719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:31.050719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:31.050719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:52:31.050719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:52:31.050719 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:52:31.051716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:52:31.051716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:31.051716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:31.051716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:31.051716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:31.051716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:31.051716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:31.051716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:31.051716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:31.051716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:31.051716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:31.051716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:31.051716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:31.051716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:31.051716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:31.051716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:31.051716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:31.053126 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:52:31.053126 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:52:31.053126 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:52:31.053126 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:52:31.053126 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:52:31.053126 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:52:31.053126 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:52:31.053126 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:31.053126 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 432/865] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:52:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:31.057871 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65906a8a-f732-475c-a26c-ca1aab393b97 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:31.161842 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65906a8a-f732-475c-a26c-ca1aab393b97 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:31.196403 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e0c918-35a3-4620-860e-c1e5d7cca2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:31.197186 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0c918-35a3-4620-860e-c1e5d7cca2ce None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:31.197410 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0c918-35a3-4620-860e-c1e5d7cca2ce None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:31.197689 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e0c918-35a3-4620-860e-c1e5d7cca2ce None admin] PATH_INFO: `/v3/projects` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:31.198471 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0c918-35a3-4620-860e-c1e5d7cca2ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:31.198784 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0c918-35a3-4620-860e-c1e5d7cca2ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:31.200232 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e0c918-35a3-4620-860e-c1e5d7cca2ce None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:31.212509 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 434/866] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:52:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:31.218756 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed89717-530b-427b-b352-4f12f58092f0 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:31.316494 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed89717-530b-427b-b352-4f12f58092f0 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:31.350110 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725cac8e-7ed8-4ea6-a68a-1729fbe84b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:31.350764 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cac8e-7ed8-4ea6-a68a-1729fbe84b06 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:31.351050 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cac8e-7ed8-4ea6-a68a-1729fbe84b06 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:31.351330 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725cac8e-7ed8-4ea6-a68a-1729fbe84b06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:31.352157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cac8e-7ed8-4ea6-a68a-1729fbe84b06 None admin] RBAC: Adding query filter params (role.id=f38b25010c404af5bbde51980f7e8dec, scope.project.id=2a58a74d443e40a782112277c58028b6, user.id=ee845fa8cb614ce183d4608e63c3e2d4) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:31.352474 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cac8e-7ed8-4ea6-a68a-1729fbe84b06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:31.353951 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725cac8e-7ed8-4ea6-a68a-1729fbe84b06 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:31.355810 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:31.360293 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 433/867] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:52:31 2022] GET /identity/v3/role_assignments?user.id=ee845fa8cb614ce183d4608e63c3e2d4&scope.project.id=2a58a74d443e40a782112277c58028b6&role.id=f38b25010c404af5bbde51980f7e8dec => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:33.677404 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabdc1d-35d3-40a1-bdbd-ba70f3b95afd None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:33.677953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabdc1d-35d3-40a1-bdbd-ba70f3b95afd None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:33.677953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabdc1d-35d3-40a1-bdbd-ba70f3b95afd None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:33.679322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 435/868] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 12:52:33.684756 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11040553-f948-4290-825d-91e7ed08a71b None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:33.685179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11040553-f948-4290-825d-91e7ed08a71b None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:33.685324 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11040553-f948-4290-825d-91e7ed08a71b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:33.703509 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-11040553-f948-4290-825d-91e7ed08a71b None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:52:33.704799 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-11040553-f948-4290-825d-91e7ed08a71b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:52:33.779027 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 434/869] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:52:33 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:52:33.804955 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabdc1d-35d3-40a1-bdbd-ba70f3b95afd None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:33.823592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:33.909196 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabdc1d-35d3-40a1-bdbd-ba70f3b95afd None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:33.942391 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ad987-128b-40b1-a9b6-b5080a86ce05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:33.943116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ad987-128b-40b1-a9b6-b5080a86ce05 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:33.943394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ad987-128b-40b1-a9b6-b5080a86ce05 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:33.943668 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803ad987-128b-40b1-a9b6-b5080a86ce05 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:33.953737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803ad987-128b-40b1-a9b6-b5080a86ce05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:52:33.961684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-803ad987-128b-40b1-a9b6-b5080a86ce05 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:52:33.961684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:33.961684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:33.961684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:33.961684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:33.961684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:33.961684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:33.961684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:33.961684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:33.961684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:33.961684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:33.961684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:33.961684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:52:33.961684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:52:33.961684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:52:33.961684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:52:33.962757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:52:33.962757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:52:33.962757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:52:33.962757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:52:33.962757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:33.962757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:33.962757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:33.962757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:33.962757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:33.962757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:33.962757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:33.962757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:33.962757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:33.962757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:33.962757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:33.962757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:33.963653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:33.963653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:33.963653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:33.963653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:33.963653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:52:33.963653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:52:33.963653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:52:33.963653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:52:33.963653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:52:33.963653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:52:33.963653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:52:33.963653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:52:33.963653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 436/870] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 12:52:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:33.968932 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11040553-f948-4290-825d-91e7ed08a71b None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:34.072909 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11040553-f948-4290-825d-91e7ed08a71b None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:34.099599 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:34.107653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61da01f-296e-4e59-83f0-11d407ace270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:34.108321 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61da01f-296e-4e59-83f0-11d407ace270 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:34.108608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61da01f-296e-4e59-83f0-11d407ace270 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:34.108920 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61da01f-296e-4e59-83f0-11d407ace270 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:34.109667 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61da01f-296e-4e59-83f0-11d407ace270 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:34.109979 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61da01f-296e-4e59-83f0-11d407ace270 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:34.111342 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61da01f-296e-4e59-83f0-11d407ace270 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:34.119477 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 435/871] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:52:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:34.125180 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ad987-128b-40b1-a9b6-b5080a86ce05 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:34.204213 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:34.227912 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803ad987-128b-40b1-a9b6-b5080a86ce05 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:34.260074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59feada-5ee7-4a2b-b8ce-5ea606ae2aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:34.260902 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59feada-5ee7-4a2b-b8ce-5ea606ae2aab None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:34.261189 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59feada-5ee7-4a2b-b8ce-5ea606ae2aab None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:34.261469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59feada-5ee7-4a2b-b8ce-5ea606ae2aab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:34.272188 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59feada-5ee7-4a2b-b8ce-5ea606ae2aab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:34.273663 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59feada-5ee7-4a2b-b8ce-5ea606ae2aab None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:34.290850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-a59feada-5ee7-4a2b-b8ce-5ea606ae2aab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:34.290850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:34.290850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:34.290850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:34.290850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:34.290850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:34.290850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:34.290850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:34.290850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:34.290850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:34.290850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:34.290850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:34.290850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:52:34.290850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:52:34.290850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:52:34.291914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:52:34.291914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:34.291914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:34.291914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:34.291914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:34.291914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:34.291914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:34.291914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:34.291914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:34.291914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:34.291914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:34.291914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:34.291914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:34.291914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:34.291914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:34.291914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:34.291914 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:34.293008 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:52:34.293008 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:52:34.293008 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:34.293008 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:52:34.293008 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 437/872] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:34.298254 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61da01f-296e-4e59-83f0-11d407ace270 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:34.397569 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61da01f-296e-4e59-83f0-11d407ace270 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:34.430539 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c10659-5bbe-44bf-ae48-cc6bcfbdfee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:34.431199 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c10659-5bbe-44bf-ae48-cc6bcfbdfee0 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:34.431484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c10659-5bbe-44bf-ae48-cc6bcfbdfee0 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:34.431763 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c10659-5bbe-44bf-ae48-cc6bcfbdfee0 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:34.432589 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c10659-5bbe-44bf-ae48-cc6bcfbdfee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:34.432929 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c10659-5bbe-44bf-ae48-cc6bcfbdfee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:34.434306 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c10659-5bbe-44bf-ae48-cc6bcfbdfee0 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:34.446846 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 436/873] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:34.453107 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59feada-5ee7-4a2b-b8ce-5ea606ae2aab None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:34.555001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59feada-5ee7-4a2b-b8ce-5ea606ae2aab None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:34.581725 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:34.589828 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf536ea-d6d0-4211-994e-9a51e0e464e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:34.590792 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf536ea-d6d0-4211-994e-9a51e0e464e4 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:34.591081 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf536ea-d6d0-4211-994e-9a51e0e464e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:34.591358 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf536ea-d6d0-4211-994e-9a51e0e464e4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:34.599520 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf536ea-d6d0-4211-994e-9a51e0e464e4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:34.600986 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf536ea-d6d0-4211-994e-9a51e0e464e4 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:34.615227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-caf536ea-d6d0-4211-994e-9a51e0e464e4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 12:52:34.615227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:34.615227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:34.615227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:34.615227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:34.615227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:34.615227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:34.615227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:34.615227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:34.615227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:34.615227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:34.615227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:34.615227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:52:34.615227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:52:34.615227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:52:34.615227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:52:34.616318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:34.616318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:34.616318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:52:34.616318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:52:34.616318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:52:34.616318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:52:34.616318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:34.616318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:34.616318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:34.616318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:34.616318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:34.616318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:34.616318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:34.616318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:34.616318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:34.616318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:34.616318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:34.616318 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:34.617386 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:34.617386 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:34.617386 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:52:34.617386 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:52:34.617386 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:52:34.617386 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:52:34.617386 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:52:34.617386 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:52:34.617386 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 12:52:34.617386 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:52:34.617386 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 438/874] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:34.622560 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c10659-5bbe-44bf-ae48-cc6bcfbdfee0 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:34.672410 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:34.721060 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c10659-5bbe-44bf-ae48-cc6bcfbdfee0 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:34.753520 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08044313-2284-49d7-916d-9405a98f989a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:34.754176 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08044313-2284-49d7-916d-9405a98f989a None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:34.754454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08044313-2284-49d7-916d-9405a98f989a None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:34.754724 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08044313-2284-49d7-916d-9405a98f989a None admin] PATH_INFO: `/v3/users` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:34.755573 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08044313-2284-49d7-916d-9405a98f989a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:34.755882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08044313-2284-49d7-916d-9405a98f989a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:34.757353 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08044313-2284-49d7-916d-9405a98f989a None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:34.776735 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 437/875] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jul 14 12:52:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:34.783095 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf536ea-d6d0-4211-994e-9a51e0e464e4 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:34.883246 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf536ea-d6d0-4211-994e-9a51e0e464e4 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:34.915866 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c82fe-44a6-47ba-855b-e8a63bd5b095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:34.916509 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c82fe-44a6-47ba-855b-e8a63bd5b095 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:34.916827 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c82fe-44a6-47ba-855b-e8a63bd5b095 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:34.917106 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c82fe-44a6-47ba-855b-e8a63bd5b095 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:34.970944 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:34.982684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c82fe-44a6-47ba-855b-e8a63bd5b095 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:34.984138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c82fe-44a6-47ba-855b-e8a63bd5b095 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:35.081631 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 439/876] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:52:34 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 12:52:35.087645 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08044313-2284-49d7-916d-9405a98f989a None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:35.189265 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08044313-2284-49d7-916d-9405a98f989a None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:35.198522 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:35.223020 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b47987-0f16-4cdd-9bb3-f4a4bdf2784f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:35.223804 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b47987-0f16-4cdd-9bb3-f4a4bdf2784f None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:35.224091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b47987-0f16-4cdd-9bb3-f4a4bdf2784f None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:35.224370 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b47987-0f16-4cdd-9bb3-f4a4bdf2784f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:35.234189 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b47987-0f16-4cdd-9bb3-f4a4bdf2784f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:35.235632 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b47987-0f16-4cdd-9bb3-f4a4bdf2784f None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:35.254074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-73b47987-0f16-4cdd-9bb3-f4a4bdf2784f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:35.254074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:35.254074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:35.254074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:35.254074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:35.254074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:35.254074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:35.254074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:35.254074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:35.254074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:35.254074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:35.254074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:35.254074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:52:35.254074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:52:35.254074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:52:35.255160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:52:35.255160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:35.255160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:35.255160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:35.255160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:35.255160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:35.255160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:35.255160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:35.255160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:35.255160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:35.255160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:35.255160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:35.255160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:35.255160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:35.255160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:35.255160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:35.255160 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:35.256142 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:52:35.256142 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:52:35.256142 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:35.256142 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:35.256142 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 438/877] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:35.261040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c82fe-44a6-47ba-855b-e8a63bd5b095 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:35.348743 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:35.361867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c82fe-44a6-47ba-855b-e8a63bd5b095 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:35.395493 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb5aab-fd11-4b01-a8cc-fd23329810ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:35.396154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb5aab-fd11-4b01-a8cc-fd23329810ee None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:35.396440 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb5aab-fd11-4b01-a8cc-fd23329810ee None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:35.396760 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34eb5aab-fd11-4b01-a8cc-fd23329810ee None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:35.397483 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb5aab-fd11-4b01-a8cc-fd23329810ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:35.397795 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb5aab-fd11-4b01-a8cc-fd23329810ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:35.399356 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34eb5aab-fd11-4b01-a8cc-fd23329810ee None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:35.411852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 440/878] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:35.417557 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b47987-0f16-4cdd-9bb3-f4a4bdf2784f None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:35.516428 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b47987-0f16-4cdd-9bb3-f4a4bdf2784f None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:35.550194 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b5876-4a55-4aea-89d7-58655436734b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:35.550990 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b5876-4a55-4aea-89d7-58655436734b None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:35.551257 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b5876-4a55-4aea-89d7-58655436734b None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:35.551560 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3b5876-4a55-4aea-89d7-58655436734b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:35.558150 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b5876-4a55-4aea-89d7-58655436734b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:35.565585 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3b5876-4a55-4aea-89d7-58655436734b None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:35.572936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-de3b5876-4a55-4aea-89d7-58655436734b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:52:35.572936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:35.572936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:35.572936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:35.572936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:35.572936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:35.572936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:35.572936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:35.572936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:35.572936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:35.572936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:35.572936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:35.572936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:52:35.572936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:52:35.572936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:52:35.574124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:52:35.574124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:35.574124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:35.574124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:35.574124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:35.574124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:35.574124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:35.574124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:35.574124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:35.574124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:35.574124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:35.574124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:35.574124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:35.574124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:35.574124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:35.574124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:35.574124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:35.575143 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:52:35.575143 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:52:35.575143 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:52:35.575143 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:52:35.575143 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:52:35.575143 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:52:35.575143 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:52:35.575143 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:35.575143 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 439/879] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:52:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:35.580405 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb5aab-fd11-4b01-a8cc-fd23329810ee None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:35.679715 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34eb5aab-fd11-4b01-a8cc-fd23329810ee None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:35.713250 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3bc287-ffa3-4a48-afdb-beb56e4bf5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:35.713906 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bc287-ffa3-4a48-afdb-beb56e4bf5c6 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:35.714193 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bc287-ffa3-4a48-afdb-beb56e4bf5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:35.714474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3bc287-ffa3-4a48-afdb-beb56e4bf5c6 None admin] PATH_INFO: `/v3/projects` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:35.715259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bc287-ffa3-4a48-afdb-beb56e4bf5c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:35.715573 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bc287-ffa3-4a48-afdb-beb56e4bf5c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:35.717037 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3bc287-ffa3-4a48-afdb-beb56e4bf5c6 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:35.729345 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 441/880] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:52:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:35.735333 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b5876-4a55-4aea-89d7-58655436734b None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:35.757059 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:35.831318 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3b5876-4a55-4aea-89d7-58655436734b None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:35.863665 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a10096-28d0-47d8-b6ec-186e5005ee7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:35.866343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a10096-28d0-47d8-b6ec-186e5005ee7b None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:35.866343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a10096-28d0-47d8-b6ec-186e5005ee7b None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:35.866343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a10096-28d0-47d8-b6ec-186e5005ee7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:35.866343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a10096-28d0-47d8-b6ec-186e5005ee7b None admin] RBAC: Adding query filter params (role.id=9bca71f77ac24a898d3445ab3c205809, scope.project.id=2a58a74d443e40a782112277c58028b6, user.id=ee845fa8cb614ce183d4608e63c3e2d4) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:35.866343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a10096-28d0-47d8-b6ec-186e5005ee7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:35.867377 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a10096-28d0-47d8-b6ec-186e5005ee7b None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:35.872546 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 440/881] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:52:35 2022] GET /identity/v3/role_assignments?user.id=ee845fa8cb614ce183d4608e63c3e2d4&scope.project.id=2a58a74d443e40a782112277c58028b6&role.id=9bca71f77ac24a898d3445ab3c205809 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:38.069215 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416308e-08fd-4fe7-94ef-51142e274521 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:38.069777 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416308e-08fd-4fe7-94ef-51142e274521 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:38.069777 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c416308e-08fd-4fe7-94ef-51142e274521 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:38.071138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 442/882] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:52:38.076481 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a3567-ee5f-4021-84fc-c57aeda42b66 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:38.076914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a3567-ee5f-4021-84fc-c57aeda42b66 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:38.077172 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8a3567-ee5f-4021-84fc-c57aeda42b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:38.095054 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-4b8a3567-ee5f-4021-84fc-c57aeda42b66 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:52:38.096243 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-4b8a3567-ee5f-4021-84fc-c57aeda42b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:52:38.166647 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 441/883] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:52:38 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:52:38.192400 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416308e-08fd-4fe7-94ef-51142e274521 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:38.203360 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:38.300364 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c416308e-08fd-4fe7-94ef-51142e274521 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:38.334232 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b31ff3-6be9-422f-a746-44e893fe726a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:38.334951 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b31ff3-6be9-422f-a746-44e893fe726a None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:38.335239 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b31ff3-6be9-422f-a746-44e893fe726a None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:38.335521 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b31ff3-6be9-422f-a746-44e893fe726a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:38.346387 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b31ff3-6be9-422f-a746-44e893fe726a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:52:38.354221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-42b31ff3-6be9-422f-a746-44e893fe726a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:52:38.354221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:38.354221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:38.354221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:38.354221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:38.354221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:38.354221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:38.354221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:38.354221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:38.354221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:38.354221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:38.354221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:38.354221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:52:38.354221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:52:38.354221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:52:38.354221 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:52:38.355151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:52:38.355151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:52:38.355151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:52:38.355151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:52:38.355151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:38.355151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:38.355151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:38.355151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:38.355151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:38.355151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:38.355151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:38.355151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:38.355151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:38.355151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:38.355151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:38.355151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:38.355990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:38.355990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:38.355990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:38.355990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:38.355990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:52:38.355990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:52:38.355990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:52:38.355990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:52:38.355990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:52:38.355990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:52:38.355990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:52:38.355990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:52:38.355990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 443/884] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 12:52:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:38.362322 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a3567-ee5f-4021-84fc-c57aeda42b66 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:38.377588 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:38.459018 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8a3567-ee5f-4021-84fc-c57aeda42b66 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:38.492924 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fea614-f1dd-4a7c-a24c-b1b7ba05f406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:38.493580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fea614-f1dd-4a7c-a24c-b1b7ba05f406 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:38.493865 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fea614-f1dd-4a7c-a24c-b1b7ba05f406 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:38.494142 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fea614-f1dd-4a7c-a24c-b1b7ba05f406 None admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:38.494875 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fea614-f1dd-4a7c-a24c-b1b7ba05f406 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:38.495179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fea614-f1dd-4a7c-a24c-b1b7ba05f406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:38.496534 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fea614-f1dd-4a7c-a24c-b1b7ba05f406 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:38.504304 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 442/885] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:52:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 12:52:38.510088 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b31ff3-6be9-422f-a746-44e893fe726a None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:38.575223 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:38.610090 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b31ff3-6be9-422f-a746-44e893fe726a None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:38.642612 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b0678-d339-4f34-9e71-3d0323a98ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:38.643407 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b0678-d339-4f34-9e71-3d0323a98ba5 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:38.643694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b0678-d339-4f34-9e71-3d0323a98ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:38.643974 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b0678-d339-4f34-9e71-3d0323a98ba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:38.654267 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b0678-d339-4f34-9e71-3d0323a98ba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:38.655718 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b0678-d339-4f34-9e71-3d0323a98ba5 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:38.672980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-322b0678-d339-4f34-9e71-3d0323a98ba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:38.672980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:38.672980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:38.672980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:38.672980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:38.672980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:38.672980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:38.672980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:38.672980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:38.672980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:38.672980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:38.672980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:38.672980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:52:38.672980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:52:38.672980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:52:38.673935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:52:38.673935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:38.673935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:38.673935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:38.673935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:38.673935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:38.673935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:38.673935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:38.673935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:38.673935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:38.673935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:38.673935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:38.673935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:38.673935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:38.673935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:38.673935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:38.673935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:38.674838 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:52:38.674838 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:52:38.674838 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:38.674838 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:52:38.674838 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 444/886] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:38.680290 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fea614-f1dd-4a7c-a24c-b1b7ba05f406 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:38.755590 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:38.778144 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fea614-f1dd-4a7c-a24c-b1b7ba05f406 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:38.811251 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a5745-cc27-41e4-ba19-fdc14a0c1b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:38.811903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a5745-cc27-41e4-ba19-fdc14a0c1b92 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:38.812188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a5745-cc27-41e4-ba19-fdc14a0c1b92 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:38.812473 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800a5745-cc27-41e4-ba19-fdc14a0c1b92 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:38.813222 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a5745-cc27-41e4-ba19-fdc14a0c1b92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:38.813530 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a5745-cc27-41e4-ba19-fdc14a0c1b92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:38.814892 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800a5745-cc27-41e4-ba19-fdc14a0c1b92 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:38.826678 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 443/887] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:38.833133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b0678-d339-4f34-9e71-3d0323a98ba5 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:38.933091 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b0678-d339-4f34-9e71-3d0323a98ba5 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:38.952184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:38.966354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318111e-3413-4140-aee3-561fc4054ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:38.967138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318111e-3413-4140-aee3-561fc4054ce5 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:38.967418 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318111e-3413-4140-aee3-561fc4054ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:38.967690 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b318111e-3413-4140-aee3-561fc4054ce5 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:38.975066 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318111e-3413-4140-aee3-561fc4054ce5 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:38.976499 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b318111e-3413-4140-aee3-561fc4054ce5 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:38.990469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-b318111e-3413-4140-aee3-561fc4054ce5 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 12:52:38.990469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:38.990469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:38.990469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:38.990469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:38.990469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:38.990469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:38.990469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:38.990469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:38.990469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:38.990469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:38.990469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:38.990469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:52:38.990469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:52:38.990469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:52:38.990469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:52:38.991604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:38.991604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:38.991604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:52:38.991604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:52:38.991604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:52:38.991604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:52:38.991604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:38.991604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:38.991604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:38.991604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:38.991604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:38.991604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:38.991604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:38.991604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:38.991604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:38.991604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:38.991604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:38.991604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:38.992549 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:38.992549 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:38.992549 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:52:38.992549 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:52:38.992549 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:52:38.992549 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:52:38.992549 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:52:38.992549 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:52:38.992549 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 12:52:38.992549 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:52:38.992549 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 445/888] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:38.997640 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a5745-cc27-41e4-ba19-fdc14a0c1b92 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:39.098914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800a5745-cc27-41e4-ba19-fdc14a0c1b92 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:39.133342 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edc678-2a4d-492d-978b-472054caee48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:39.134015 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edc678-2a4d-492d-978b-472054caee48 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:39.134297 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edc678-2a4d-492d-978b-472054caee48 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:39.134571 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10edc678-2a4d-492d-978b-472054caee48 None admin] PATH_INFO: `/v3/users` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:39.135404 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edc678-2a4d-492d-978b-472054caee48 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:39.135713 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edc678-2a4d-492d-978b-472054caee48 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:39.137166 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10edc678-2a4d-492d-978b-472054caee48 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:39.140387 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:39.155087 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 444/889] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jul 14 12:52:38 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:39.160883 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318111e-3413-4140-aee3-561fc4054ce5 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:39.259887 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b318111e-3413-4140-aee3-561fc4054ce5 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:39.293046 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89bb6d-9f8b-4710-ad54-0690f2d9c69c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:39.293828 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89bb6d-9f8b-4710-ad54-0690f2d9c69c None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:39.294114 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89bb6d-9f8b-4710-ad54-0690f2d9c69c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:39.294388 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89bb6d-9f8b-4710-ad54-0690f2d9c69c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:39.305413 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89bb6d-9f8b-4710-ad54-0690f2d9c69c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:39.306860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89bb6d-9f8b-4710-ad54-0690f2d9c69c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:39.324182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-df89bb6d-9f8b-4710-ad54-0690f2d9c69c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:39.324182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:39.324182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:39.324182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:39.324182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:39.324182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:39.324182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:39.324182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:39.324182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:39.324182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:39.324182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:39.324182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:39.324182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:52:39.324182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:52:39.324182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:52:39.325255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:52:39.325255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:39.325255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:39.325255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:39.325255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:39.325255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:39.325255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:39.325255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:39.325255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:39.325255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:39.325255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:39.325255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:39.325255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:39.325255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:39.325255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:39.325255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:39.325255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:39.326217 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:52:39.326217 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:52:39.326217 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:39.326217 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:52:39.326217 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 446/890] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:39.331385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edc678-2a4d-492d-978b-472054caee48 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:39.431000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10edc678-2a4d-492d-978b-472054caee48 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:39.466497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a604f-8360-4faa-8e62-e9157711b915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:39.467156 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a604f-8360-4faa-8e62-e9157711b915 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:39.467441 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a604f-8360-4faa-8e62-e9157711b915 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:39.467716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064a604f-8360-4faa-8e62-e9157711b915 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:39.468435 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a604f-8360-4faa-8e62-e9157711b915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:39.468772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a604f-8360-4faa-8e62-e9157711b915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:39.470141 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064a604f-8360-4faa-8e62-e9157711b915 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:39.481455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 445/891] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:52:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:39.487740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89bb6d-9f8b-4710-ad54-0690f2d9c69c None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:39.519862 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:39.585918 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89bb6d-9f8b-4710-ad54-0690f2d9c69c None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:39.619792 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b0208-3cd0-4326-9d62-193265a6416c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:39.620579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b0208-3cd0-4326-9d62-193265a6416c None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:39.620890 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b0208-3cd0-4326-9d62-193265a6416c None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:39.621204 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b0208-3cd0-4326-9d62-193265a6416c None admin] PATH_INFO: `/v3/projects/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:39.628309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b0208-3cd0-4326-9d62-193265a6416c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:39.629814 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b0208-3cd0-4326-9d62-193265a6416c None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:39.644067 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-727b0208-3cd0-4326-9d62-193265a6416c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:52:39.644067 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:39.644067 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:39.644067 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:39.644067 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:39.644067 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:39.644067 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:39.644067 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:39.644067 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:39.644067 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:39.644067 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:39.644067 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:39.644067 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:52:39.644067 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:52:39.644067 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:52:39.645190 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:52:39.645190 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:39.645190 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:39.645190 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:39.645190 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:39.645190 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:39.645190 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:39.645190 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:39.645190 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:39.645190 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:39.645190 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:39.645190 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:39.645190 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:39.645190 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:39.645190 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:39.645190 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:39.645190 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:39.646123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:52:39.646123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:52:39.646123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:52:39.646123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:52:39.646123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:52:39.646123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:52:39.646123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:52:39.646123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:52:39.646123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 447/892] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:52:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:39.651178 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a604f-8360-4faa-8e62-e9157711b915 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:39.705098 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:39.754005 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064a604f-8360-4faa-8e62-e9157711b915 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:39.787164 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dab43b-1d0c-41b9-a336-7e4c6d5c4152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:39.787738 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dab43b-1d0c-41b9-a336-7e4c6d5c4152 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:39.788024 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dab43b-1d0c-41b9-a336-7e4c6d5c4152 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:39.788298 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dab43b-1d0c-41b9-a336-7e4c6d5c4152 None admin] PATH_INFO: `/v3/projects` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:39.789119 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dab43b-1d0c-41b9-a336-7e4c6d5c4152 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:39.789430 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dab43b-1d0c-41b9-a336-7e4c6d5c4152 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:39.790855 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2dab43b-1d0c-41b9-a336-7e4c6d5c4152 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:39.803507 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 446/893] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:52:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:39.809942 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b0208-3cd0-4326-9d62-193265a6416c None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:39.899379 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:39.908239 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b0208-3cd0-4326-9d62-193265a6416c None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:39.940760 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ec99a-d5ec-4ca8-9e8b-8bc686f99e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:39.941639 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ec99a-d5ec-4ca8-9e8b-8bc686f99e35 None admin] REQUEST_METHOD: `PUT` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:39.941920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ec99a-d5ec-4ca8-9e8b-8bc686f99e35 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:39.942192 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ec99a-d5ec-4ca8-9e8b-8bc686f99e35 None admin] PATH_INFO: `/v3/projects/2a58a74d443e40a782112277c58028b6/users/ee845fa8cb614ce183d4608e63c3e2d4/roles/9bca71f77ac24a898d3445ab3c205809` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:39.944133 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ec99a-d5ec-4ca8-9e8b-8bc686f99e35 None admin] RBAC: Authorizing `identity:create_grant(project_id=2a58a74d443e40a782112277c58028b6, user_id=ee845fa8cb614ce183d4608e63c3e2d4, role_id=9bca71f77ac24a898d3445ab3c205809)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:39.945585 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ec99a-d5ec-4ca8-9e8b-8bc686f99e35 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:40.029701 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 448/894] 10.222.0.40 () {58 vars in 1439 bytes} [Thu Jul 14 12:52:39 2022] PUT /identity/v3/projects/2a58a74d443e40a782112277c58028b6/users/ee845fa8cb614ce183d4608e63c3e2d4/roles/9bca71f77ac24a898d3445ab3c205809 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 12:52:42.284485 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b55ea-3f33-4ba1-850a-707a7088fe6c None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:42.285037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b55ea-3f33-4ba1-850a-707a7088fe6c None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:42.285125 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2b55ea-3f33-4ba1-850a-707a7088fe6c None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:42.286450 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 447/895] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:52:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:52:42.291797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa563418-c8f0-40cb-8c71-53e3c59ea7a5 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:42.292240 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa563418-c8f0-40cb-8c71-53e3c59ea7a5 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:42.292340 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa563418-c8f0-40cb-8c71-53e3c59ea7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:42.309827 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-aa563418-c8f0-40cb-8c71-53e3c59ea7a5 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:52:42.311018 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-aa563418-c8f0-40cb-8c71-53e3c59ea7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:52:42.376313 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 449/896] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:52:42 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:52:42.401422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b55ea-3f33-4ba1-850a-707a7088fe6c None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:42.505818 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2b55ea-3f33-4ba1-850a-707a7088fe6c None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:42.520015 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:42.539386 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be14e67-d766-4133-ab9f-e20d1366192d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:42.540164 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be14e67-d766-4133-ab9f-e20d1366192d None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:42.540442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be14e67-d766-4133-ab9f-e20d1366192d None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:42.540754 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be14e67-d766-4133-ab9f-e20d1366192d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:42.550776 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be14e67-d766-4133-ab9f-e20d1366192d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 14 12:52:42.558420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-5be14e67-d766-4133-ab9f-e20d1366192d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:52:42.558420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:42.558420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:42.558420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:42.558420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:42.558420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:42.558420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:42.558420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:42.558420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:42.558420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:42.558420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:42.558420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:42.558420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 14 12:52:42.558420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 14 12:52:42.558420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 14 12:52:42.558420 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 14 12:52:42.559705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 14 12:52:42.559705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 14 12:52:42.559705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 14 12:52:42.559705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 14 12:52:42.559705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:42.559705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:42.559705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:42.559705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:42.559705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:42.559705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:42.559705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:42.559705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:42.559705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:42.559705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:42.559705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:42.559705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:42.560766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:42.560766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:42.560766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:42.560766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:42.560766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 14 12:52:42.560766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 14 12:52:42.560766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 14 12:52:42.560766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 14 12:52:42.560766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 14 12:52:42.560766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 14 12:52:42.560766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 14 12:52:42.560766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:42.560766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 448/897] 10.222.0.40 () {56 vars in 1096 bytes} [Thu Jul 14 12:52:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:42.565776 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa563418-c8f0-40cb-8c71-53e3c59ea7a5 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:42.648189 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:42.665968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa563418-c8f0-40cb-8c71-53e3c59ea7a5 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:42.699014 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df7a09-cb21-4d6d-b0f1-3e8a9e094eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:42.699674 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df7a09-cb21-4d6d-b0f1-3e8a9e094eea None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:42.699951 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df7a09-cb21-4d6d-b0f1-3e8a9e094eea None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:42.700218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87df7a09-cb21-4d6d-b0f1-3e8a9e094eea None admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:42.700992 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df7a09-cb21-4d6d-b0f1-3e8a9e094eea None admin] RBAC: Adding query filter params (name=admin) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:42.701296 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df7a09-cb21-4d6d-b0f1-3e8a9e094eea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:42.702653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87df7a09-cb21-4d6d-b0f1-3e8a9e094eea None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:42.711648 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 450/898] 10.222.0.40 () {56 vars in 1099 bytes} [Thu Jul 14 12:52:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:42.717407 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be14e67-d766-4133-ab9f-e20d1366192d None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:42.815136 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be14e67-d766-4133-ab9f-e20d1366192d None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:42.848694 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7f985-50e1-4ea4-a068-2e9629ff4245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:42.849473 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7f985-50e1-4ea4-a068-2e9629ff4245 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:42.849760 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7f985-50e1-4ea4-a068-2e9629ff4245 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:42.850043 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d7f985-50e1-4ea4-a068-2e9629ff4245 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:42.861555 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7f985-50e1-4ea4-a068-2e9629ff4245 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:42.863047 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d7f985-50e1-4ea4-a068-2e9629ff4245 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:42.881936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-c4d7f985-50e1-4ea4-a068-2e9629ff4245 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:42.881936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:42.881936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:42.881936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:42.881936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:42.881936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:42.881936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:42.881936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:42.881936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:42.881936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:42.881936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:42.881936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:42.881936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:52:42.881936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:52:42.881936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:52:42.883390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:52:42.883390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:42.883390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:42.883390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:42.883390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:42.883390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:42.883390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:42.883390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:42.883390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:42.883390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:42.883390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:42.883390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:42.883390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:42.883390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:42.883390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:42.883390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:42.883390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:42.884502 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:52:42.884502 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:52:42.884502 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:42.884502 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:42.884502 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 449/899] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:42.889497 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df7a09-cb21-4d6d-b0f1-3e8a9e094eea None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:42.990816 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87df7a09-cb21-4d6d-b0f1-3e8a9e094eea None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:43.024367 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a58103-0f5c-4672-baa7-bbc7d404d22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:43.025057 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a58103-0f5c-4672-baa7-bbc7d404d22f None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:43.025327 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a58103-0f5c-4672-baa7-bbc7d404d22f None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:43.025600 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a58103-0f5c-4672-baa7-bbc7d404d22f None admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:43.026307 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a58103-0f5c-4672-baa7-bbc7d404d22f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:43.026610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a58103-0f5c-4672-baa7-bbc7d404d22f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:43.027962 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a58103-0f5c-4672-baa7-bbc7d404d22f None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:43.039354 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 451/900] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:43.045992 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7f985-50e1-4ea4-a068-2e9629ff4245 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:43.074311 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:43.146685 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d7f985-50e1-4ea4-a068-2e9629ff4245 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:43.180154 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ae8cb-bdfd-464f-bee6-b8aa847b0eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:43.180991 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ae8cb-bdfd-464f-bee6-b8aa847b0eca None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:43.181275 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ae8cb-bdfd-464f-bee6-b8aa847b0eca None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:43.181550 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958ae8cb-bdfd-464f-bee6-b8aa847b0eca None admin] PATH_INFO: `/v3/users/placement` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:43.189708 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ae8cb-bdfd-464f-bee6-b8aa847b0eca None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:43.191128 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958ae8cb-bdfd-464f-bee6-b8aa847b0eca None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:43.205033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-958ae8cb-bdfd-464f-bee6-b8aa847b0eca None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 14 12:52:43.205033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:43.205033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:43.205033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:43.205033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:43.205033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:43.205033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:43.205033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:43.205033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:43.205033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:43.205033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:43.205033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:43.205033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 14 12:52:43.205033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 14 12:52:43.205033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 14 12:52:43.205033 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 14 12:52:43.206179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:43.206179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:43.206179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 14 12:52:43.206179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:52:43.206179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 14 12:52:43.206179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 14 12:52:43.206179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:43.206179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:43.206179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:43.206179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:43.206179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:43.206179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:43.206179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:43.206179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:43.206179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:43.206179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:43.206179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:43.206179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:43.207189 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:43.207189 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:43.207189 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 14 12:52:43.207189 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 14 12:52:43.207189 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 14 12:52:43.207189 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 14 12:52:43.207189 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 14 12:52:43.207189 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 14 12:52:43.207189 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 14 12:52:43.207189 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:43.207189 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 450/901] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:43.213776 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a58103-0f5c-4672-baa7-bbc7d404d22f None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:43.217686 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:43.312372 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a58103-0f5c-4672-baa7-bbc7d404d22f None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:43.347374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea418a71-6a12-4373-b226-5f12b413c5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:43.348077 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea418a71-6a12-4373-b226-5f12b413c5ed None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:43.348357 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea418a71-6a12-4373-b226-5f12b413c5ed None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:43.348630 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea418a71-6a12-4373-b226-5f12b413c5ed None admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:43.349483 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea418a71-6a12-4373-b226-5f12b413c5ed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:43.349789 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea418a71-6a12-4373-b226-5f12b413c5ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:43.352836 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea418a71-6a12-4373-b226-5f12b413c5ed None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:43.368355 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 452/902] 10.222.0.40 () {56 vars in 1143 bytes} [Thu Jul 14 12:52:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:43.374712 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ae8cb-bdfd-464f-bee6-b8aa847b0eca None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:43.460006 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:43.475141 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958ae8cb-bdfd-464f-bee6-b8aa847b0eca None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:43.508041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3add3-5917-4812-8169-e9a170c84c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:43.508715 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3add3-5917-4812-8169-e9a170c84c33 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:43.509008 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3add3-5917-4812-8169-e9a170c84c33 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:43.509283 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3add3-5917-4812-8169-e9a170c84c33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:43.580373 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3add3-5917-4812-8169-e9a170c84c33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:43.581778 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a3add3-5917-4812-8169-e9a170c84c33 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:43.677641 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 451/903] 10.222.0.40 () {58 vars in 1282 bytes} [Thu Jul 14 12:52:43 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 14 12:52:43.683476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea418a71-6a12-4373-b226-5f12b413c5ed None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:43.744939 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:43.773058 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:43.784249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea418a71-6a12-4373-b226-5f12b413c5ed None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:43.825694 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b0c7b-68ff-4f4c-b309-deade5d3f213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:43.826501 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b0c7b-68ff-4f4c-b309-deade5d3f213 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:43.826784 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b0c7b-68ff-4f4c-b309-deade5d3f213 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:43.827055 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162b0c7b-68ff-4f4c-b309-deade5d3f213 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:43.838362 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b0c7b-68ff-4f4c-b309-deade5d3f213 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:43.839751 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162b0c7b-68ff-4f4c-b309-deade5d3f213 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:43.857289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-162b0c7b-68ff-4f4c-b309-deade5d3f213 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:43.857289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:43.857289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:43.857289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:43.857289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:43.857289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:43.857289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:43.857289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:43.857289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:43.857289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:43.857289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:43.857289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:43.857289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 14 12:52:43.857289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 14 12:52:43.857289 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 14 12:52:43.860453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 14 12:52:43.860453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:43.860453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:43.860453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:43.860453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:43.860453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:43.860453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:43.860453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:43.860453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:43.860453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:43.860453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:43.860453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:43.860453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:43.860453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:43.860453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:43.860453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:43.860453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:43.862181 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 14 12:52:43.862181 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 14 12:52:43.862181 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 14 12:52:43.862181 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:52:43.862181 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 453/904] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 12:52:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:43.865492 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3add3-5917-4812-8169-e9a170c84c33 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:43.962334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a3add3-5917-4812-8169-e9a170c84c33 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:43.995808 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d4d25-b673-4476-89a5-6f6218341322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:43.996475 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d4d25-b673-4476-89a5-6f6218341322 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:43.996797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d4d25-b673-4476-89a5-6f6218341322 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:43.997081 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775d4d25-b673-4476-89a5-6f6218341322 None admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:43.997801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d4d25-b673-4476-89a5-6f6218341322 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:43.998114 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d4d25-b673-4476-89a5-6f6218341322 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:43.999545 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775d4d25-b673-4476-89a5-6f6218341322 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:44.011203 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 452/905] 10.222.0.40 () {56 vars in 1109 bytes} [Thu Jul 14 12:52:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:44.016994 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b0c7b-68ff-4f4c-b309-deade5d3f213 None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:44.121285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162b0c7b-68ff-4f4c-b309-deade5d3f213 None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:44.136762 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:44.155855 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388f779-9b83-4fda-a529-087b0fe4461e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:44.156654 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388f779-9b83-4fda-a529-087b0fe4461e None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:44.156972 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388f779-9b83-4fda-a529-087b0fe4461e None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:44.157225 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4388f779-9b83-4fda-a529-087b0fe4461e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:44.164080 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388f779-9b83-4fda-a529-087b0fe4461e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:44.165527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4388f779-9b83-4fda-a529-087b0fe4461e None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:44.179280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application [None req-4388f779-9b83-4fda-a529-087b0fe4461e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:52:44.179280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:44.179280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:44.179280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:44.179280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:44.179280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:44.179280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:44.179280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:44.179280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:44.179280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:44.179280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:44.179280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:44.179280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 14 12:52:44.179280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 14 12:52:44.179280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 14 12:52:44.180352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 14 12:52:44.180352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:44.180352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:44.180352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:44.180352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:44.180352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:44.180352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:44.180352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:44.180352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:44.180352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:44.180352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:44.180352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:44.180352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:44.180352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:44.180352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:44.180352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:44.180352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:44.181308 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 14 12:52:44.181308 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 14 12:52:44.181308 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 14 12:52:44.181308 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 14 12:52:44.181308 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 14 12:52:44.181308 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 14 12:52:44.181308 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 14 12:52:44.181308 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: ERROR keystone.server.flask.application Jul 14 12:52:44.181308 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 454/906] 10.222.0.40 () {56 vars in 1111 bytes} [Thu Jul 14 12:52:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:44.186221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d4d25-b673-4476-89a5-6f6218341322 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:44.232809 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:44.292668 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775d4d25-b673-4476-89a5-6f6218341322 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:44.324941 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441ebc7b-0754-433f-a473-f0330f72c512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:44.325594 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ebc7b-0754-433f-a473-f0330f72c512 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:44.325881 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ebc7b-0754-433f-a473-f0330f72c512 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:44.326157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441ebc7b-0754-433f-a473-f0330f72c512 None admin] PATH_INFO: `/v3/projects` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:44.326934 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ebc7b-0754-433f-a473-f0330f72c512 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:44.327244 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ebc7b-0754-433f-a473-f0330f72c512 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:44.328692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441ebc7b-0754-433f-a473-f0330f72c512 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:44.340873 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 453/907] 10.222.0.40 () {56 vars in 1148 bytes} [Thu Jul 14 12:52:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:44.347531 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388f779-9b83-4fda-a529-087b0fe4461e None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:44.447571 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4388f779-9b83-4fda-a529-087b0fe4461e None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:44.481253 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc0d43-7c70-4972-a6f0-aa5753fc0d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:44.481903 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc0d43-7c70-4972-a6f0-aa5753fc0d57 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:44.482188 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc0d43-7c70-4972-a6f0-aa5753fc0d57 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:44.482463 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc0d43-7c70-4972-a6f0-aa5753fc0d57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:44.483287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc0d43-7c70-4972-a6f0-aa5753fc0d57 None admin] RBAC: Adding query filter params (role.id=9bca71f77ac24a898d3445ab3c205809, scope.project.id=2a58a74d443e40a782112277c58028b6, user.id=ee845fa8cb614ce183d4608e63c3e2d4) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:44.483601 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc0d43-7c70-4972-a6f0-aa5753fc0d57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:44.485075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc0d43-7c70-4972-a6f0-aa5753fc0d57 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:44.491446 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 455/908] 10.222.0.40 () {56 vars in 1374 bytes} [Thu Jul 14 12:52:44 2022] GET /identity/v3/role_assignments?user.id=ee845fa8cb614ce183d4608e63c3e2d4&scope.project.id=2a58a74d443e40a782112277c58028b6&role.id=9bca71f77ac24a898d3445ab3c205809 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:46.758697 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c531f-e3ae-4369-8e95-9089036bb547 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:46.759233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c531f-e3ae-4369-8e95-9089036bb547 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:46.759233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62c531f-e3ae-4369-8e95-9089036bb547 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:46.760653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 454/909] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:52:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:52:46.765945 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cad3ad-21b5-4f08-b28b-401032995b51 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:46.766410 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cad3ad-21b5-4f08-b28b-401032995b51 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:46.766518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cad3ad-21b5-4f08-b28b-401032995b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:46.784124 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-12cad3ad-21b5-4f08-b28b-401032995b51 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:52:46.795029 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-12cad3ad-21b5-4f08-b28b-401032995b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:52:46.814855 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:46.852511 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 456/910] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:52:46 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:52:46.876317 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c531f-e3ae-4369-8e95-9089036bb547 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:46.985727 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62c531f-e3ae-4369-8e95-9089036bb547 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:46.992857 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:47.019209 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e81bc1-9cbb-4e63-93a8-4ff2187d8717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:47.019924 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e81bc1-9cbb-4e63-93a8-4ff2187d8717 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:47.020205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e81bc1-9cbb-4e63-93a8-4ff2187d8717 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:47.020479 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e81bc1-9cbb-4e63-93a8-4ff2187d8717 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:47.021149 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e81bc1-9cbb-4e63-93a8-4ff2187d8717 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:47.022558 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e81bc1-9cbb-4e63-93a8-4ff2187d8717 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:47.034664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-77e81bc1-9cbb-4e63-93a8-4ff2187d8717 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 12:52:47.034664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:47.034664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:52:47.034664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:52:47.034664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:52:47.034664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:52:47.034664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:52:47.034664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:52:47.034664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 12:52:47.034664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:47.034664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:52:47.034664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:47.034664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:47.034664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:47.034664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:47.034664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:47.034664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:47.035866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:47.035866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:47.035866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:47.035866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:47.035866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:47.035866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:47.035866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:52:47.035866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:52:47.035866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:52:47.035866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:52:47.035866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:47.035866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:47.035866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:47.035866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:47.035866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:47.035866 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:47.036937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:47.036937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:47.036937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:47.036937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:47.036937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:47.036937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:47.036937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:47.036937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:47.036937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:47.036937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:47.036937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:52:47.036937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:52:47.036937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 12:52:47.036937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:47.036937 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 455/911] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 14 12:52:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:47.042128 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cad3ad-21b5-4f08-b28b-401032995b51 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:47.141322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cad3ad-21b5-4f08-b28b-401032995b51 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:47.179161 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38679b8-a4e4-495b-8a3d-019ff415da7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:47.179832 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38679b8-a4e4-495b-8a3d-019ff415da7a None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:47.180115 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38679b8-a4e4-495b-8a3d-019ff415da7a None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:47.180396 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38679b8-a4e4-495b-8a3d-019ff415da7a None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:47.181142 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38679b8-a4e4-495b-8a3d-019ff415da7a None admin] RBAC: Adding query filter params (name=placement) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:47.181453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38679b8-a4e4-495b-8a3d-019ff415da7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:47.182831 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38679b8-a4e4-495b-8a3d-019ff415da7a None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:47.187547 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 457/912] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Jul 14 12:52:47 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:47.194039 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e81bc1-9cbb-4e63-93a8-4ff2187d8717 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:47.305653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e81bc1-9cbb-4e63-93a8-4ff2187d8717 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:47.339415 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ac7de-e357-4837-a338-e30bfbe65fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:47.340069 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ac7de-e357-4837-a338-e30bfbe65fbe None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:47.340354 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ac7de-e357-4837-a338-e30bfbe65fbe None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:47.340730 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ac7de-e357-4837-a338-e30bfbe65fbe None admin] PATH_INFO: `/v3/services` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:47.341366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ac7de-e357-4837-a338-e30bfbe65fbe None admin] RBAC: Adding query filter params (type=placement) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:47.341676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ac7de-e357-4837-a338-e30bfbe65fbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:47.343042 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ac7de-e357-4837-a338-e30bfbe65fbe None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:47.347511 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 456/913] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Jul 14 12:52:47 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:49.608109 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c858f8-4bc5-438c-9b9c-f8a52bb66eeb None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:49.608698 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c858f8-4bc5-438c-9b9c-f8a52bb66eeb None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:49.608698 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c858f8-4bc5-438c-9b9c-f8a52bb66eeb None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:49.610057 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 458/914] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:52:49.615277 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216af9e-06e7-4c09-8a68-d03d11ed3651 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:49.615713 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216af9e-06e7-4c09-8a68-d03d11ed3651 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:49.615838 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216af9e-06e7-4c09-8a68-d03d11ed3651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:49.633463 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-1216af9e-06e7-4c09-8a68-d03d11ed3651 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:52:49.634609 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-1216af9e-06e7-4c09-8a68-d03d11ed3651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:52:49.661262 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:49.701496 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 457/915] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:52:49 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:52:49.726353 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c858f8-4bc5-438c-9b9c-f8a52bb66eeb None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:49.757526 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:49.831635 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c858f8-4bc5-438c-9b9c-f8a52bb66eeb None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:49.865529 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9123433-70fb-4227-ad3b-23af1bdd0dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:49.866110 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9123433-70fb-4227-ad3b-23af1bdd0dec None admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:49.866398 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9123433-70fb-4227-ad3b-23af1bdd0dec None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:49.866678 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9123433-70fb-4227-ad3b-23af1bdd0dec None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:49.867399 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9123433-70fb-4227-ad3b-23af1bdd0dec None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:49.868913 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9123433-70fb-4227-ad3b-23af1bdd0dec None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:49.979300 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 459/916] 10.222.0.40 () {60 vars in 1141 bytes} [Thu Jul 14 12:52:49 2022] POST /identity/v3/services => generated 246 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 12:52:52.218102 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebfb54-4280-4e38-9a77-f2f8c9ce276f None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:52.218687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebfb54-4280-4e38-9a77-f2f8c9ce276f None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:52.218687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baebfb54-4280-4e38-9a77-f2f8c9ce276f None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:52.220016 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 458/917] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:52:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:52:52.225201 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a1c94-2032-4487-8bce-fb0840254916 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:52.225669 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a1c94-2032-4487-8bce-fb0840254916 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:52.225769 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8a1c94-2032-4487-8bce-fb0840254916 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:52.243113 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-0f8a1c94-2032-4487-8bce-fb0840254916 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:52:52.244283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-0f8a1c94-2032-4487-8bce-fb0840254916 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:52:52.319489 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 460/918] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:52:52 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:52:52.343780 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebfb54-4280-4e38-9a77-f2f8c9ce276f None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:52.444337 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baebfb54-4280-4e38-9a77-f2f8c9ce276f None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:52.479504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94307949-cb6b-40ba-aff4-59cd96868800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:52.480311 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94307949-cb6b-40ba-aff4-59cd96868800 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:52.480672 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94307949-cb6b-40ba-aff4-59cd96868800 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:52.480902 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94307949-cb6b-40ba-aff4-59cd96868800 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:52.481557 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94307949-cb6b-40ba-aff4-59cd96868800 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:52.482930 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94307949-cb6b-40ba-aff4-59cd96868800 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:52.495320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-94307949-cb6b-40ba-aff4-59cd96868800 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 12:52:52.495320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:52.495320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:52:52.495320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:52:52.495320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:52:52.495320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:52:52.495320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:52:52.495320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:52:52.495320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 12:52:52.495320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:52.495320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:52:52.495320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:52.495320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:52.495320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:52.495320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:52.495320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:52.495320 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:52.496568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:52.496568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:52.496568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:52.496568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:52.496568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:52.496568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:52.496568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:52:52.496568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:52:52.496568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:52:52.496568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:52:52.496568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:52.496568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:52.496568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:52.496568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:52.496568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:52.496568 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:52.497700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:52.497700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:52.497700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:52.497700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:52.497700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:52.497700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:52.497700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:52.497700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:52.497700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:52.497700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:52.497700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:52:52.497700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:52:52.497700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 12:52:52.497700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:52.497700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 459/919] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 14 12:52:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:52.502664 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a1c94-2032-4487-8bce-fb0840254916 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:52.520700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:52.599405 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8a1c94-2032-4487-8bce-fb0840254916 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:52.633182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98903301-ed0c-4f5f-b995-839270101a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:52.633867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98903301-ed0c-4f5f-b995-839270101a2b None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:52.634154 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98903301-ed0c-4f5f-b995-839270101a2b None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:52.634430 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98903301-ed0c-4f5f-b995-839270101a2b None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:52.635135 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98903301-ed0c-4f5f-b995-839270101a2b None admin] RBAC: Adding query filter params (name=placement) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:52.635440 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98903301-ed0c-4f5f-b995-839270101a2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:52.636836 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98903301-ed0c-4f5f-b995-839270101a2b None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:52.641858 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 461/920] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Jul 14 12:52:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:52.647883 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94307949-cb6b-40ba-aff4-59cd96868800 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:52.677685 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:52.748976 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94307949-cb6b-40ba-aff4-59cd96868800 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:52.782274 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a76a1-c839-4e00-bb01-4545ec7267ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:52.783449 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a76a1-c839-4e00-bb01-4545ec7267ed None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:52.783739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a76a1-c839-4e00-bb01-4545ec7267ed None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:52.784018 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a76a1-c839-4e00-bb01-4545ec7267ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:52.784837 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a76a1-c839-4e00-bb01-4545ec7267ed None admin] RBAC: Adding query filter params (interface=public, service_id=e0f6bc39e22c4c8c84d4f846951dac1d, region_id=RegionOne) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:52.785155 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a76a1-c839-4e00-bb01-4545ec7267ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:52.786574 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a76a1-c839-4e00-bb01-4545ec7267ed None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:52.791744 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 460/921] 10.222.0.40 () {56 vars in 1251 bytes} [Thu Jul 14 12:52:52 2022] GET /identity/v3/endpoints?service_id=e0f6bc39e22c4c8c84d4f846951dac1d&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:52.797533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98903301-ed0c-4f5f-b995-839270101a2b None admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:52.876971 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:52.895983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98903301-ed0c-4f5f-b995-839270101a2b None admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:52.934929 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bdc40-5c06-4cd9-80c0-083eae745566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:52.935586 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bdc40-5c06-4cd9-80c0-083eae745566 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:52.935869 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bdc40-5c06-4cd9-80c0-083eae745566 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:52.936142 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bdc40-5c06-4cd9-80c0-083eae745566 None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:52.936887 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bdc40-5c06-4cd9-80c0-083eae745566 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:52.938286 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bdc40-5c06-4cd9-80c0-083eae745566 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:52.944936 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 462/922] 10.222.0.40 () {56 vars in 1087 bytes} [Thu Jul 14 12:52:52 2022] GET /identity/v3/services => generated 1962 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 12:52:55.331122 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c6cec-2d68-43d7-8cbd-8a32df31fcf8 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:55.331706 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c6cec-2d68-43d7-8cbd-8a32df31fcf8 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:55.331706 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0c6cec-2d68-43d7-8cbd-8a32df31fcf8 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:55.333212 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 461/923] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 12:52:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 12:52:55.338564 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4001e6-a79a-4963-a30b-ded02eeeab59 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:55.338997 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4001e6-a79a-4963-a30b-ded02eeeab59 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:55.339134 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4001e6-a79a-4963-a30b-ded02eeeab59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:55.355151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-ea4001e6-a79a-4963-a30b-ded02eeeab59 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 12:52:55.356320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-ea4001e6-a79a-4963-a30b-ded02eeeab59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 12:52:55.425458 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 463/924] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 12:52:55 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 14 12:52:55.449064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c6cec-2d68-43d7-8cbd-8a32df31fcf8 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:55.545002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:55.554904 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0c6cec-2d68-43d7-8cbd-8a32df31fcf8 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:55.588131 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1fa2a-c481-40ea-b9cf-436ac6a34019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:55.588958 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1fa2a-c481-40ea-b9cf-436ac6a34019 None admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:55.589242 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1fa2a-c481-40ea-b9cf-436ac6a34019 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:55.589516 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1fa2a-c481-40ea-b9cf-436ac6a34019 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:55.590165 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1fa2a-c481-40ea-b9cf-436ac6a34019 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:55.591541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1fa2a-c481-40ea-b9cf-436ac6a34019 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:55.603969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application [None req-88f1fa2a-c481-40ea-b9cf-436ac6a34019 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 12:52:55.603969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:55.603969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 14 12:52:55.603969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 14 12:52:55.603969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 14 12:52:55.603969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 14 12:52:55.603969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 14 12:52:55.603969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:52:55.603969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 12:52:55.603969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:55.603969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 14 12:52:55.603969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:55.603969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 14 12:52:55.603969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 14 12:52:55.603969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 14 12:52:55.603969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 14 12:52:55.603969 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 14 12:52:55.605334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 14 12:52:55.605334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 14 12:52:55.605334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 14 12:52:55.605334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 14 12:52:55.605334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 14 12:52:55.605334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 14 12:52:55.605334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 14 12:52:55.605334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 14 12:52:55.605334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 14 12:52:55.605334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 14 12:52:55.605334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 14 12:52:55.605334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 14 12:52:55.605334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 14 12:52:55.605334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 14 12:52:55.605334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 14 12:52:55.605334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.get_or_create( Jul 14 12:52:55.606443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 14 12:52:55.606443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application with Lock( Jul 14 12:52:55.606443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 14 12:52:55.606443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self._enter() Jul 14 12:52:55.606443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 14 12:52:55.606443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 14 12:52:55.606443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 14 12:52:55.606443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application return self.creator() Jul 14 12:52:55.606443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 14 12:52:55.606443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application created_value = creator( Jul 14 12:52:55.606443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 14 12:52:55.606443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 14 12:52:55.606443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 14 12:52:55.606443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: ERROR keystone.server.flask.application Jul 14 12:52:55.606443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 462/925] 10.222.0.40 () {56 vars in 1117 bytes} [Thu Jul 14 12:52:55 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 14 12:52:55.612117 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4001e6-a79a-4963-a30b-ded02eeeab59 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:55.709657 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:52:55.734279 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4001e6-a79a-4963-a30b-ded02eeeab59 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:55.770712 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1edef9-70a2-4ee7-ab2c-29d2fc4d6f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:55.771419 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1edef9-70a2-4ee7-ab2c-29d2fc4d6f12 None admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:55.771691 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1edef9-70a2-4ee7-ab2c-29d2fc4d6f12 None admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:55.771969 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1edef9-70a2-4ee7-ab2c-29d2fc4d6f12 None admin] PATH_INFO: `/v3/services` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:55.772741 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1edef9-70a2-4ee7-ab2c-29d2fc4d6f12 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 12:52:55.773055 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1edef9-70a2-4ee7-ab2c-29d2fc4d6f12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:55.774480 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1edef9-70a2-4ee7-ab2c-29d2fc4d6f12 None admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:55.780366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 464/926] 10.222.0.40 () {56 vars in 1116 bytes} [Thu Jul 14 12:52:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 12:52:55.787014 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1fa2a-c481-40ea-b9cf-436ac6a34019 None admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 12:52:55.895129 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1fa2a-c481-40ea-b9cf-436ac6a34019 None admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 12:52:55.932356 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c68358-8fbe-4301-91ee-71fa27fa9a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 12:52:55.933068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c68358-8fbe-4301-91ee-71fa27fa9a06 None admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 12:52:55.933350 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c68358-8fbe-4301-91ee-71fa27fa9a06 None admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 12:52:55.933627 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c68358-8fbe-4301-91ee-71fa27fa9a06 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 12:52:55.934372 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c68358-8fbe-4301-91ee-71fa27fa9a06 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 12:52:55.935754 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c68358-8fbe-4301-91ee-71fa27fa9a06 None admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 12:52:56.093888 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 463/927] 10.222.0.40 () {60 vars in 1144 bytes} [Thu Jul 14 12:52:55 2022] POST /identity/v3/endpoints => generated 331 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 12:53:05.856909 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=30 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 12:53:06.088989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:00:57.020369 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b081c-5388-4b19-810d-3a0c31cc4b3a None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:00:57.021056 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b081c-5388-4b19-810d-3a0c31cc4b3a None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:00:57.021056 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4b081c-5388-4b19-810d-3a0c31cc4b3a None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:00:57.026297 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 465/928] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:00:57.028108 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63451e-aa30-48a2-af04-f3c6768ec0ac None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:00:57.028559 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63451e-aa30-48a2-af04-f3c6768ec0ac None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:00:57.028793 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63451e-aa30-48a2-af04-f3c6768ec0ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:00:57.120504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-db63451e-aa30-48a2-af04-f3c6768ec0ac None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:00:57.121771 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-db63451e-aa30-48a2-af04-f3c6768ec0ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:00:57.257823 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 464/929] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:00:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:00:57.309904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ea719-448a-4543-a45f-038ce2f792b3 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:00:57.310197 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ea719-448a-4543-a45f-038ce2f792b3 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:00:57.310582 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ea719-448a-4543-a45f-038ce2f792b3 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:00:57.316159 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 466/930] 10.222.0.40 () {54 vars in 964 bytes} [Thu Jul 14 13:00:57 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 13:00:57.319496 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece2849-daf1-4ef0-beb3-15bd4627a219 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:00:57.319793 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece2849-daf1-4ef0-beb3-15bd4627a219 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:00:57.320074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ece2849-daf1-4ef0-beb3-15bd4627a219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:00:57.433733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-7ece2849-daf1-4ef0-beb3-15bd4627a219 None None] MFA Rules not processed for user `513bc0a2d10240a5bc12cb402da41faf`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:00:57.434742 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-7ece2849-daf1-4ef0-beb3-15bd4627a219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:00:57.470790 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:00:57.537198 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 465/931] 10.222.0.40 () {58 vars in 1061 bytes} [Thu Jul 14 13:00:57 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:00:57.545235 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ea719-448a-4543-a45f-038ce2f792b3 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:00:57.558320 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583ea719-448a-4543-a45f-038ce2f792b3 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:00:57.561898 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ba069c-7b72-40fc-bdee-f5e6dc22b0a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:00:57.562545 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba069c-7b72-40fc-bdee-f5e6dc22b0a3 service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:00:57.562870 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba069c-7b72-40fc-bdee-f5e6dc22b0a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:00:57.563166 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ba069c-7b72-40fc-bdee-f5e6dc22b0a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:00:57.573053 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba069c-7b72-40fc-bdee-f5e6dc22b0a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:00:57.574536 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ba069c-7b72-40fc-bdee-f5e6dc22b0a3 service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:00:57.587105 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 467/932] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:00:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:01:00.157121 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6831e26-c93a-4457-8980-d697328aab62 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:00.157645 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6831e26-c93a-4457-8980-d697328aab62 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:00.157746 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6831e26-c93a-4457-8980-d697328aab62 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:00.159377 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 466/933] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:01:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:00.165029 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a2d38-52c8-41af-ae13-c07c175b5c9b None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:00.165477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a2d38-52c8-41af-ae13-c07c175b5c9b None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:00.165601 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8a2d38-52c8-41af-ae13-c07c175b5c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:00.183788 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-bc8a2d38-52c8-41af-ae13-c07c175b5c9b None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:00.185033 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-bc8a2d38-52c8-41af-ae13-c07c175b5c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:00.193458 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 468/934] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:01:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:00.233451 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6831e26-c93a-4457-8980-d697328aab62 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:01:00.244692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6831e26-c93a-4457-8980-d697328aab62 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:01:00.248296 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151edc1-d7f5-4603-afb9-a081cdfa7d0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:01:00.249071 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151edc1-d7f5-4603-afb9-a081cdfa7d0e service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:00.249356 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151edc1-d7f5-4603-afb9-a081cdfa7d0e service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:00.249641 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151edc1-d7f5-4603-afb9-a081cdfa7d0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:00.259686 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151edc1-d7f5-4603-afb9-a081cdfa7d0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:01:00.261189 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151edc1-d7f5-4603-afb9-a081cdfa7d0e service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:01:00.271825 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 467/935] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:01:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:01:03.177823 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2f3bc-53c8-4b7b-899d-3bc323d5892c None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:03.178410 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2f3bc-53c8-4b7b-899d-3bc323d5892c None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:03.178410 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2f3bc-53c8-4b7b-899d-3bc323d5892c None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:03.179755 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 469/936] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:03.185114 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19cace-cc31-4b0b-bde7-7467728784b4 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:03.185569 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19cace-cc31-4b0b-bde7-7467728784b4 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:03.185677 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19cace-cc31-4b0b-bde7-7467728784b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:03.242553 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-bf19cace-cc31-4b0b-bde7-7467728784b4 None None] MFA Rules not processed for user `1a085e27599f4ca2adeff79d06f81706`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:03.243740 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-bf19cace-cc31-4b0b-bde7-7467728784b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:03.325263 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 468/937] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:01:03 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:03.366100 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2f3bc-53c8-4b7b-899d-3bc323d5892c None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:01:03.376831 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad2f3bc-53c8-4b7b-899d-3bc323d5892c None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:01:03.380375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112a8cbc-fb9c-4430-bb10-020117cdf52a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:01:03.381061 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a8cbc-fb9c-4430-bb10-020117cdf52a service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:03.381344 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a8cbc-fb9c-4430-bb10-020117cdf52a service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:03.381621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112a8cbc-fb9c-4430-bb10-020117cdf52a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:03.390684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a8cbc-fb9c-4430-bb10-020117cdf52a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:01:03.392070 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112a8cbc-fb9c-4430-bb10-020117cdf52a service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:01:03.401401 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 470/938] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:01:03 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:01:06.782205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9b926-1b6a-41d2-8ac8-0018bb5ef095 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:06.782772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9b926-1b6a-41d2-8ac8-0018bb5ef095 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:06.782772 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c9b926-1b6a-41d2-8ac8-0018bb5ef095 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:06.784098 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 469/939] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:06.790100 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5260b-db67-4fa6-9109-4251f2f6d943 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:06.790515 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5260b-db67-4fa6-9109-4251f2f6d943 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:06.790718 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d5260b-db67-4fa6-9109-4251f2f6d943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:06.809010 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-27d5260b-db67-4fa6-9109-4251f2f6d943 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:06.810230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-27d5260b-db67-4fa6-9109-4251f2f6d943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:06.877023 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 471/940] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:01:06 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:06.931737 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182eee69-4ce8-4630-9ad1-5a34e8cf939a None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:06.932023 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182eee69-4ce8-4630-9ad1-5a34e8cf939a None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:06.932416 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182eee69-4ce8-4630-9ad1-5a34e8cf939a None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:06.933823 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 470/941] 10.222.0.40 () {54 vars in 964 bytes} [Thu Jul 14 13:01:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:06.939812 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022036b-28d9-475d-a102-5a1574443547 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:06.940099 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022036b-28d9-475d-a102-5a1574443547 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:06.940375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2022036b-28d9-475d-a102-5a1574443547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:06.959366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-2022036b-28d9-475d-a102-5a1574443547 None None] MFA Rules not processed for user `513bc0a2d10240a5bc12cb402da41faf`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:06.960550 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-2022036b-28d9-475d-a102-5a1574443547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:06.966861 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 472/942] 10.222.0.40 () {58 vars in 1061 bytes} [Thu Jul 14 13:01:06 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 13:01:06.975673 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182eee69-4ce8-4630-9ad1-5a34e8cf939a None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:01:06.986234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182eee69-4ce8-4630-9ad1-5a34e8cf939a None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:01:06.989770 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61d7855-e443-422f-9cbd-c8bcf39946be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:01:06.990399 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d7855-e443-422f-9cbd-c8bcf39946be service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:06.990709 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d7855-e443-422f-9cbd-c8bcf39946be service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:06.990965 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61d7855-e443-422f-9cbd-c8bcf39946be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:06.999800 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d7855-e443-422f-9cbd-c8bcf39946be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:01:07.001281 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61d7855-e443-422f-9cbd-c8bcf39946be service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:01:07.011605 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 471/943] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:01:06 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:01:10.727664 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d9790-dab3-47ab-81b4-3e57e11b468b None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:10.728234 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d9790-dab3-47ab-81b4-3e57e11b468b None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:10.728234 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d9790-dab3-47ab-81b4-3e57e11b468b None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:10.729632 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 473/944] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:01:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:10.734942 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0dc28-deb2-4446-a7d1-1a966fdfd127 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:10.735430 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0dc28-deb2-4446-a7d1-1a966fdfd127 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:10.735542 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c0dc28-deb2-4446-a7d1-1a966fdfd127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:10.753593 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-54c0dc28-deb2-4446-a7d1-1a966fdfd127 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:10.755340 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-54c0dc28-deb2-4446-a7d1-1a966fdfd127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:10.763225 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 472/945] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:01:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 13:01:10.799658 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d9790-dab3-47ab-81b4-3e57e11b468b None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:01:10.810369 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d9790-dab3-47ab-81b4-3e57e11b468b None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:01:10.813849 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d897d9-5a67-4481-9ce9-30e7897b3bc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:01:10.814483 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d897d9-5a67-4481-9ce9-30e7897b3bc7 service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:10.814770 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d897d9-5a67-4481-9ce9-30e7897b3bc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:10.815048 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d897d9-5a67-4481-9ce9-30e7897b3bc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:10.824699 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d897d9-5a67-4481-9ce9-30e7897b3bc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:01:10.826151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d897d9-5a67-4481-9ce9-30e7897b3bc7 service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:01:10.836336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 474/946] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:01:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:01:13.150009 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d17457-a536-4021-8c52-7f59281ba41f None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:13.150532 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d17457-a536-4021-8c52-7f59281ba41f None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:13.150647 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d17457-a536-4021-8c52-7f59281ba41f None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:13.151971 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 473/947] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:01:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:13.157314 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8744808-80b8-4b8d-aa27-62719c517579 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:13.157767 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8744808-80b8-4b8d-aa27-62719c517579 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:13.157875 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8744808-80b8-4b8d-aa27-62719c517579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:13.176078 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-f8744808-80b8-4b8d-aa27-62719c517579 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:13.177856 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-f8744808-80b8-4b8d-aa27-62719c517579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:13.185671 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 475/948] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:01:13 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:13.222677 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d17457-a536-4021-8c52-7f59281ba41f None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:01:13.233789 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d17457-a536-4021-8c52-7f59281ba41f None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:01:13.237322 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e52323-9724-4642-be6b-465a6951b347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:01:13.238038 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e52323-9724-4642-be6b-465a6951b347 service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:13.238231 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e52323-9724-4642-be6b-465a6951b347 service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:13.238506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e52323-9724-4642-be6b-465a6951b347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:13.248275 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e52323-9724-4642-be6b-465a6951b347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:01:13.249745 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e52323-9724-4642-be6b-465a6951b347 service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:01:13.259633 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 474/949] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:01:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:01:15.578781 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460fdf8-fd71-4472-8d17-3e3c85212084 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:15.579347 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460fdf8-fd71-4472-8d17-3e3c85212084 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:15.579347 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460fdf8-fd71-4472-8d17-3e3c85212084 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:15.580747 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 476/950] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:01:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:15.586623 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8cad5-5e60-4c4b-aeff-7a3477e94726 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:15.587102 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8cad5-5e60-4c4b-aeff-7a3477e94726 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:15.587331 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab8cad5-5e60-4c4b-aeff-7a3477e94726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:15.606106 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-dab8cad5-5e60-4c4b-aeff-7a3477e94726 None None] MFA Rules not processed for user `1a085e27599f4ca2adeff79d06f81706`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:15.607300 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-dab8cad5-5e60-4c4b-aeff-7a3477e94726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:15.615115 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 475/951] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:01:15 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:15.653206 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460fdf8-fd71-4472-8d17-3e3c85212084 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:01:15.663892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460fdf8-fd71-4472-8d17-3e3c85212084 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:01:15.667613 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771f0a4-6880-45dd-9979-88ef632641cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:01:15.668255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771f0a4-6880-45dd-9979-88ef632641cd service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:15.668547 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771f0a4-6880-45dd-9979-88ef632641cd service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:15.668866 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771f0a4-6880-45dd-9979-88ef632641cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:15.678726 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771f0a4-6880-45dd-9979-88ef632641cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:01:15.680166 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771f0a4-6880-45dd-9979-88ef632641cd service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:01:15.689794 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 477/952] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:01:15 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:01:18.504994 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bdc49-091e-4885-a393-6f71faea35d6 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:18.505524 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bdc49-091e-4885-a393-6f71faea35d6 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:18.505634 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bdc49-091e-4885-a393-6f71faea35d6 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:18.506921 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 476/953] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:01:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:18.512176 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c70cef-fabb-4179-8bc9-4a29ea87b83a None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:18.512618 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c70cef-fabb-4179-8bc9-4a29ea87b83a None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:18.512748 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c70cef-fabb-4179-8bc9-4a29ea87b83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:18.530777 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-b9c70cef-fabb-4179-8bc9-4a29ea87b83a None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:18.531955 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-b9c70cef-fabb-4179-8bc9-4a29ea87b83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:18.540336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 478/954] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:01:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:18.576711 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bdc49-091e-4885-a393-6f71faea35d6 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:01:18.587909 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bdc49-091e-4885-a393-6f71faea35d6 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:01:18.591400 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bb04b9-9759-44ce-bae1-c5815f63c822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:01:18.592036 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb04b9-9759-44ce-bae1-c5815f63c822 service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:18.592321 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb04b9-9759-44ce-bae1-c5815f63c822 service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:18.592598 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bb04b9-9759-44ce-bae1-c5815f63c822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:18.602598 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb04b9-9759-44ce-bae1-c5815f63c822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:01:18.604046 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bb04b9-9759-44ce-bae1-c5815f63c822 service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:01:18.608049 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:01:18.614130 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 477/955] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:01:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:01:20.972243 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113cb1d-6f38-4ffa-a76c-2fd449cbeab3 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:20.972781 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113cb1d-6f38-4ffa-a76c-2fd449cbeab3 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:20.972781 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113cb1d-6f38-4ffa-a76c-2fd449cbeab3 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:20.974209 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 479/956] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:01:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:20.979455 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61656848-b748-402b-8250-d8718daba20f None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:20.979875 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61656848-b748-402b-8250-d8718daba20f None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:20.980011 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61656848-b748-402b-8250-d8718daba20f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:20.998032 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-61656848-b748-402b-8250-d8718daba20f None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:20.999210 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-61656848-b748-402b-8250-d8718daba20f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:21.007545 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 478/957] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:01:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:21.047321 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113cb1d-6f38-4ffa-a76c-2fd449cbeab3 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:01:21.058466 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113cb1d-6f38-4ffa-a76c-2fd449cbeab3 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:01:21.061960 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2d320-1458-4f18-81f7-8fc752b92cad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:01:21.062593 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2d320-1458-4f18-81f7-8fc752b92cad service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:21.062882 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2d320-1458-4f18-81f7-8fc752b92cad service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:21.063163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2d320-1458-4f18-81f7-8fc752b92cad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:21.072604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2d320-1458-4f18-81f7-8fc752b92cad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:01:21.074074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2d320-1458-4f18-81f7-8fc752b92cad service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:01:21.083462 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 480/958] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:01:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:01:23.964712 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a97a83-5b2f-46d7-88c8-df890d15bbec None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:23.965253 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a97a83-5b2f-46d7-88c8-df890d15bbec None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:23.965253 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a97a83-5b2f-46d7-88c8-df890d15bbec None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:23.966645 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 479/959] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:01:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:23.971965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf5734-62bc-4d53-b71b-77c3a1231dad None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:23.972352 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf5734-62bc-4d53-b71b-77c3a1231dad None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:23.972518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccf5734-62bc-4d53-b71b-77c3a1231dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:23.991188 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-7ccf5734-62bc-4d53-b71b-77c3a1231dad None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:23.992367 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-7ccf5734-62bc-4d53-b71b-77c3a1231dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:23.999939 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 481/960] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:01:23 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:24.036313 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a97a83-5b2f-46d7-88c8-df890d15bbec None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:01:24.046890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a97a83-5b2f-46d7-88c8-df890d15bbec None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:01:24.050482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08b36f5-a4cc-4a12-8b5e-ebb70a3e7678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:01:24.051108 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b36f5-a4cc-4a12-8b5e-ebb70a3e7678 service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:24.051395 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b36f5-a4cc-4a12-8b5e-ebb70a3e7678 service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:24.051675 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08b36f5-a4cc-4a12-8b5e-ebb70a3e7678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:24.065921 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b36f5-a4cc-4a12-8b5e-ebb70a3e7678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:01:24.068303 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08b36f5-a4cc-4a12-8b5e-ebb70a3e7678 service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:01:24.077949 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 480/961] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:01:24 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:01:28.606706 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7488dd-a5dd-4551-b13a-94cbd26d1364 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:28.607235 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7488dd-a5dd-4551-b13a-94cbd26d1364 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:28.607339 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7488dd-a5dd-4551-b13a-94cbd26d1364 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:28.608693 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 482/962] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:01:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:28.616385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e165f53-b928-4a57-b571-121aabf77ea4 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:28.616927 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e165f53-b928-4a57-b571-121aabf77ea4 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:28.617043 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e165f53-b928-4a57-b571-121aabf77ea4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:28.635782 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-2e165f53-b928-4a57-b571-121aabf77ea4 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:28.637036 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-2e165f53-b928-4a57-b571-121aabf77ea4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:28.645120 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 481/963] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:01:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:28.685596 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7488dd-a5dd-4551-b13a-94cbd26d1364 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:01:28.691104 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=77 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:01:28.698086 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7488dd-a5dd-4551-b13a-94cbd26d1364 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:01:28.702557 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f436c233-995c-4ed9-bc98-0e92dabac57d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:01:28.709249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436c233-995c-4ed9-bc98-0e92dabac57d service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:28.709249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436c233-995c-4ed9-bc98-0e92dabac57d service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:28.709249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f436c233-995c-4ed9-bc98-0e92dabac57d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:28.714123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436c233-995c-4ed9-bc98-0e92dabac57d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:01:28.715506 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f436c233-995c-4ed9-bc98-0e92dabac57d service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:01:28.725604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 483/964] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:01:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:01:32.029201 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485877ce-0a95-4381-a532-836d67868697 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:32.029735 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485877ce-0a95-4381-a532-836d67868697 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:32.029735 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485877ce-0a95-4381-a532-836d67868697 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:32.031109 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 482/965] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:01:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:32.036785 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8713645-5a0d-4aac-9a19-4703fe69423e None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:32.037245 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8713645-5a0d-4aac-9a19-4703fe69423e None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:32.037340 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8713645-5a0d-4aac-9a19-4703fe69423e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:32.055977 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-e8713645-5a0d-4aac-9a19-4703fe69423e None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:32.057209 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-e8713645-5a0d-4aac-9a19-4703fe69423e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:32.065104 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 484/966] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:01:32 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:32.103476 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485877ce-0a95-4381-a532-836d67868697 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:01:32.115361 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485877ce-0a95-4381-a532-836d67868697 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:01:32.123880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fe3c37-1ae5-4c0a-a40a-f87d7cee4e61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:01:32.131425 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe3c37-1ae5-4c0a-a40a-f87d7cee4e61 service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:32.131425 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe3c37-1ae5-4c0a-a40a-f87d7cee4e61 service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:32.131425 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fe3c37-1ae5-4c0a-a40a-f87d7cee4e61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:32.136224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe3c37-1ae5-4c0a-a40a-f87d7cee4e61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:01:32.137747 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fe3c37-1ae5-4c0a-a40a-f87d7cee4e61 service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:01:32.148027 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 483/967] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:01:32 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:01:36.721927 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98686af5-1faf-4717-a8de-592f3f550914 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:36.722478 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98686af5-1faf-4717-a8de-592f3f550914 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:36.722478 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98686af5-1faf-4717-a8de-592f3f550914 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:36.724350 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 485/968] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:01:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:36.729634 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d4d1d-3e8d-4a5b-a924-26f726e04a03 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:36.730074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d4d1d-3e8d-4a5b-a924-26f726e04a03 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:36.730173 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719d4d1d-3e8d-4a5b-a924-26f726e04a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:36.747728 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-719d4d1d-3e8d-4a5b-a924-26f726e04a03 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:36.749022 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-719d4d1d-3e8d-4a5b-a924-26f726e04a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:36.756833 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 484/969] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:01:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:36.795850 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98686af5-1faf-4717-a8de-592f3f550914 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:01:36.807634 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98686af5-1faf-4717-a8de-592f3f550914 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:01:36.811088 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e679c2d-a899-47de-94d2-1053cf1d706f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:01:36.812041 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e679c2d-a899-47de-94d2-1053cf1d706f service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:36.812321 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e679c2d-a899-47de-94d2-1053cf1d706f service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:36.812589 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e679c2d-a899-47de-94d2-1053cf1d706f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:36.822447 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e679c2d-a899-47de-94d2-1053cf1d706f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:01:36.823875 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e679c2d-a899-47de-94d2-1053cf1d706f service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:01:36.833343 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 486/970] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:01:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:01:42.187633 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f723ae-0484-4a99-ba71-7f41a4a240fe None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:42.188565 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f723ae-0484-4a99-ba71-7f41a4a240fe None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:42.189077 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f723ae-0484-4a99-ba71-7f41a4a240fe None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:42.197184 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 485/971] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 13:01:42 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:42.201990 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89909c28-3702-40c3-b297-41ce22c3b5df None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:42.202776 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89909c28-3702-40c3-b297-41ce22c3b5df None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:42.203061 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89909c28-3702-40c3-b297-41ce22c3b5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:42.244954 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-89909c28-3702-40c3-b297-41ce22c3b5df None None] MFA Rules not processed for user `ee845fa8cb614ce183d4608e63c3e2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:42.246569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-89909c28-3702-40c3-b297-41ce22c3b5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:42.322823 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 487/972] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 13:01:42 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:46.744625 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=22 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:01:46.777470 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd1558-9695-4820-93dd-c26dd7db9d92 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:46.778031 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd1558-9695-4820-93dd-c26dd7db9d92 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:46.778576 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd1558-9695-4820-93dd-c26dd7db9d92 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:46.780267 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 486/973] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 13:01:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:46.785912 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735b594-8640-44ce-a4f6-84e9b19f3eaa None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:46.786940 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735b594-8640-44ce-a4f6-84e9b19f3eaa None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:46.787192 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a735b594-8640-44ce-a4f6-84e9b19f3eaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:46.808196 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-a735b594-8640-44ce-a4f6-84e9b19f3eaa None None] MFA Rules not processed for user `ee845fa8cb614ce183d4608e63c3e2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:46.809455 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-a735b594-8640-44ce-a4f6-84e9b19f3eaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:46.818953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 488/974] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 13:01:46 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:48.332686 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1ba75-8346-4a39-8192-dbef0d352b6c None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:48.333229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1ba75-8346-4a39-8192-dbef0d352b6c None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:48.333326 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc1ba75-8346-4a39-8192-dbef0d352b6c None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:48.334647 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 487/975] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 13:01:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:48.340936 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73957e-9d9c-421c-aad3-416fd771d335 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:48.341321 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73957e-9d9c-421c-aad3-416fd771d335 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:48.342011 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb73957e-9d9c-421c-aad3-416fd771d335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:48.361246 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-eb73957e-9d9c-421c-aad3-416fd771d335 None None] MFA Rules not processed for user `ee845fa8cb614ce183d4608e63c3e2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:48.362425 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-eb73957e-9d9c-421c-aad3-416fd771d335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:48.371726 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 489/976] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 13:01:48 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:52.477083 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf292bd-bb37-4c41-9134-2270026a5c62 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:52.478097 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf292bd-bb37-4c41-9134-2270026a5c62 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:52.478423 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf292bd-bb37-4c41-9134-2270026a5c62 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:52.480035 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 488/977] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:01:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:52.485472 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3f8eb-1a87-4023-bfed-33211621cf00 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:52.485982 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3f8eb-1a87-4023-bfed-33211621cf00 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:52.486075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c3f8eb-1a87-4023-bfed-33211621cf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:52.506380 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-98c3f8eb-1a87-4023-bfed-33211621cf00 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:52.508211 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-98c3f8eb-1a87-4023-bfed-33211621cf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:52.517336 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 490/978] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:01:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:52.574346 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493cd0e-b54b-40cf-bd9f-51752996e0e3 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:52.576566 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493cd0e-b54b-40cf-bd9f-51752996e0e3 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:52.576566 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d493cd0e-b54b-40cf-bd9f-51752996e0e3 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:52.576566 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 489/979] 10.222.0.40 () {54 vars in 961 bytes} [Thu Jul 14 13:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:52.585015 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7593804-0968-4333-8d1d-d9eb810de814 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:52.586163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7593804-0968-4333-8d1d-d9eb810de814 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:52.586822 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7593804-0968-4333-8d1d-d9eb810de814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:52.644165 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-e7593804-0968-4333-8d1d-d9eb810de814 None None] MFA Rules not processed for user `1faa19de04744a4084a9c60c4af64f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:52.645407 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-e7593804-0968-4333-8d1d-d9eb810de814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:52.702028 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:01:52.724576 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 491/980] 10.222.0.40 () {58 vars in 1058 bytes} [Thu Jul 14 13:01:52 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:52.732846 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493cd0e-b54b-40cf-bd9f-51752996e0e3 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:01:52.747148 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d493cd0e-b54b-40cf-bd9f-51752996e0e3 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:01:52.752942 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a6e1d-fdd7-40b0-bd01-4d14ebe3dd35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:01:52.753718 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a6e1d-fdd7-40b0-bd01-4d14ebe3dd35 service nova] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:52.754074 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a6e1d-fdd7-40b0-bd01-4d14ebe3dd35 service nova] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:52.754527 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a6e1d-fdd7-40b0-bd01-4d14ebe3dd35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:52.763892 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a6e1d-fdd7-40b0-bd01-4d14ebe3dd35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:01:52.765612 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a6e1d-fdd7-40b0-bd01-4d14ebe3dd35 service nova] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:01:52.776494 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 490/981] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:01:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:01:55.251030 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb058f-3e29-414b-9bae-e918e47f4d23 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:55.251614 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb058f-3e29-414b-9bae-e918e47f4d23 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:55.251614 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddb058f-3e29-414b-9bae-e918e47f4d23 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:55.253209 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 492/982] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:01:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:55.258543 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5448c38-95fc-4146-bed0-afa6ed30f727 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:55.259008 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5448c38-95fc-4146-bed0-afa6ed30f727 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:55.259088 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5448c38-95fc-4146-bed0-afa6ed30f727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:55.277650 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-a5448c38-95fc-4146-bed0-afa6ed30f727 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:55.278909 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-a5448c38-95fc-4146-bed0-afa6ed30f727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:55.289064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 491/983] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:01:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:55.332305 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb058f-3e29-414b-9bae-e918e47f4d23 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:01:55.348245 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddb058f-3e29-414b-9bae-e918e47f4d23 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:01:55.353653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7ec16-d6fe-4e58-8bfa-ab57038c9cdd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:01:55.354376 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7ec16-d6fe-4e58-8bfa-ab57038c9cdd service nova] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:55.354733 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7ec16-d6fe-4e58-8bfa-ab57038c9cdd service nova] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:55.355087 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7ec16-d6fe-4e58-8bfa-ab57038c9cdd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:55.364932 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7ec16-d6fe-4e58-8bfa-ab57038c9cdd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:01:55.366628 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7ec16-d6fe-4e58-8bfa-ab57038c9cdd service nova] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:01:55.378939 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 493/984] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:01:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:01:58.117748 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa233ed-675d-45bd-abd4-6ec5a52bcdb2 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:58.118270 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa233ed-675d-45bd-abd4-6ec5a52bcdb2 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:58.118419 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa233ed-675d-45bd-abd4-6ec5a52bcdb2 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:58.119675 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 492/985] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:01:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:58.125059 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb72e9-aaf1-412a-b4e9-48e41b09c3d5 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:58.125482 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb72e9-aaf1-412a-b4e9-48e41b09c3d5 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:58.125641 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdb72e9-aaf1-412a-b4e9-48e41b09c3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:58.147852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-6bdb72e9-aaf1-412a-b4e9-48e41b09c3d5 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:58.149127 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-6bdb72e9-aaf1-412a-b4e9-48e41b09c3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:58.156952 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 494/986] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:01:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:58.213037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a2205-2ba8-4afc-b3e7-6bcdbf3a2f2a None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:58.213675 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a2205-2ba8-4afc-b3e7-6bcdbf3a2f2a None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:58.214722 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a2205-2ba8-4afc-b3e7-6bcdbf3a2f2a None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:58.216217 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 493/987] 10.222.0.40 () {54 vars in 961 bytes} [Thu Jul 14 13:01:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:01:58.226456 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f567fc-6d43-42e0-bad4-71027a513d15 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:58.226846 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f567fc-6d43-42e0-bad4-71027a513d15 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:58.227190 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f567fc-6d43-42e0-bad4-71027a513d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:58.247673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-16f567fc-6d43-42e0-bad4-71027a513d15 None None] MFA Rules not processed for user `1faa19de04744a4084a9c60c4af64f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:01:58.249100 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-16f567fc-6d43-42e0-bad4-71027a513d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:01:58.258256 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 495/988] 10.222.0.40 () {58 vars in 1058 bytes} [Thu Jul 14 13:01:58 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:01:58.266051 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a2205-2ba8-4afc-b3e7-6bcdbf3a2f2a None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:01:58.279415 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a2205-2ba8-4afc-b3e7-6bcdbf3a2f2a None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:01:58.284414 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df26903d-f14c-41cc-bee9-ef82fd277663 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:01:58.285152 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26903d-f14c-41cc-bee9-ef82fd277663 service nova] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:01:58.285496 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26903d-f14c-41cc-bee9-ef82fd277663 service nova] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:01:58.285833 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df26903d-f14c-41cc-bee9-ef82fd277663 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:01:58.294107 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26903d-f14c-41cc-bee9-ef82fd277663 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:01:58.295785 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df26903d-f14c-41cc-bee9-ef82fd277663 service nova] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:01:58.305967 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 494/989] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:01:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:00.823848 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89787272-fa43-4975-8c2b-44454c2266fb None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:00.824855 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89787272-fa43-4975-8c2b-44454c2266fb None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:00.825287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89787272-fa43-4975-8c2b-44454c2266fb None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:00.827118 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 496/990] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:02:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:00.832992 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed369f97-6776-4271-aa6e-c3a25282c39f None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:00.833893 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed369f97-6776-4271-aa6e-c3a25282c39f None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:00.834336 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed369f97-6776-4271-aa6e-c3a25282c39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:00.854692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-ed369f97-6776-4271-aa6e-c3a25282c39f None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:00.856264 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-ed369f97-6776-4271-aa6e-c3a25282c39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:00.865335 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 495/991] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:02:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:00.914047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89787272-fa43-4975-8c2b-44454c2266fb None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:00.934612 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89787272-fa43-4975-8c2b-44454c2266fb None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:00.943218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821a11d-a626-4f54-ba17-847817b97a84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:00.944794 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821a11d-a626-4f54-ba17-847817b97a84 service nova] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:00.944794 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821a11d-a626-4f54-ba17-847817b97a84 service nova] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:00.944794 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821a11d-a626-4f54-ba17-847817b97a84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:00.954729 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821a11d-a626-4f54-ba17-847817b97a84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:00.956569 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821a11d-a626-4f54-ba17-847817b97a84 service nova] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:00.968767 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 497/992] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:02.712941 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50adcd-e3cb-46ab-b4bd-887678404739 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:02.713386 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50adcd-e3cb-46ab-b4bd-887678404739 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:02.713480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce50adcd-e3cb-46ab-b4bd-887678404739 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:02.718683 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 496/993] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:02:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:02.720273 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9ba0e-c28f-4dd1-ae63-f4ac5108f726 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:02.720703 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9ba0e-c28f-4dd1-ae63-f4ac5108f726 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:02.720992 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee9ba0e-c28f-4dd1-ae63-f4ac5108f726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:02.754077 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-7ee9ba0e-c28f-4dd1-ae63-f4ac5108f726 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:02.756514 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-7ee9ba0e-c28f-4dd1-ae63-f4ac5108f726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:02.788281 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 498/994] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:02:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:03.156601 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f243d82-6d90-4daa-91db-13be5e59e9da None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:03.156601 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f243d82-6d90-4daa-91db-13be5e59e9da None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:03.156601 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f243d82-6d90-4daa-91db-13be5e59e9da None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:03.159138 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 497/995] 10.222.0.40 () {54 vars in 963 bytes} [Thu Jul 14 13:02:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:03.164880 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343edd22-2ead-48d5-8091-c6962c9fe094 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:03.165264 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343edd22-2ead-48d5-8091-c6962c9fe094 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:03.165610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343edd22-2ead-48d5-8091-c6962c9fe094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:03.221069 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-343edd22-2ead-48d5-8091-c6962c9fe094 None None] MFA Rules not processed for user `efbe88187dd84518818114165f60a5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:03.222328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-343edd22-2ead-48d5-8091-c6962c9fe094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:03.285967 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 499/996] 10.222.0.40 () {58 vars in 1060 bytes} [Thu Jul 14 13:02:03 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:03.294322 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f243d82-6d90-4daa-91db-13be5e59e9da None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:03.305959 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f243d82-6d90-4daa-91db-13be5e59e9da None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:03.309485 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8037e9-b9e1-4b40-8c9c-855ded0d01de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbe88187dd84518818114165f60a5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:03.310131 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8037e9-b9e1-4b40-8c9c-855ded0d01de service cinder] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:03.310414 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8037e9-b9e1-4b40-8c9c-855ded0d01de service cinder] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:03.310691 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8037e9-b9e1-4b40-8c9c-855ded0d01de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:03.320080 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8037e9-b9e1-4b40-8c9c-855ded0d01de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:03.321544 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8037e9-b9e1-4b40-8c9c-855ded0d01de service cinder] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:03.331467 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 498/997] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:03.583860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c0383-98ba-4882-a7ff-765fa9e7ff33 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:03.584155 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c0383-98ba-4882-a7ff-765fa9e7ff33 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:03.584759 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c0383-98ba-4882-a7ff-765fa9e7ff33 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:03.586303 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 500/998] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:02:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:03.591631 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a57a2-9ed7-439e-853a-6931a0668f98 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:03.592015 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a57a2-9ed7-439e-853a-6931a0668f98 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:03.592346 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a57a2-9ed7-439e-853a-6931a0668f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:03.611015 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-1e2a57a2-9ed7-439e-853a-6931a0668f98 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:03.612292 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-1e2a57a2-9ed7-439e-853a-6931a0668f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:03.621636 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 499/999] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:02:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:03.667116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c0383-98ba-4882-a7ff-765fa9e7ff33 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:03.681874 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c0383-98ba-4882-a7ff-765fa9e7ff33 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:03.687689 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405201e-791b-4a64-b0ea-fa48b99ea822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:03.688465 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405201e-791b-4a64-b0ea-fa48b99ea822 service nova] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:03.688806 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405201e-791b-4a64-b0ea-fa48b99ea822 service nova] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:03.689159 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405201e-791b-4a64-b0ea-fa48b99ea822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:03.700010 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405201e-791b-4a64-b0ea-fa48b99ea822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:03.706314 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405201e-791b-4a64-b0ea-fa48b99ea822 service nova] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:03.717161 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 501/1000] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:06.279834 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a81636-3a6a-4650-8c4d-8d2e6f79b005 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:06.280814 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a81636-3a6a-4650-8c4d-8d2e6f79b005 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:06.281248 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a81636-3a6a-4650-8c4d-8d2e6f79b005 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:06.283056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 500/1001] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:02:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:06.289098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e6093-50ec-42c7-905d-ae32c2a6c7be None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:06.290031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e6093-50ec-42c7-905d-ae32c2a6c7be None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:06.290484 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9e6093-50ec-42c7-905d-ae32c2a6c7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:06.319851 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-0a9e6093-50ec-42c7-905d-ae32c2a6c7be None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:06.321372 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-0a9e6093-50ec-42c7-905d-ae32c2a6c7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:06.339946 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 502/1002] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:02:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:06.389765 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a81636-3a6a-4650-8c4d-8d2e6f79b005 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:06.404190 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a81636-3a6a-4650-8c4d-8d2e6f79b005 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:06.410002 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebbb9b4-a613-4252-8dd2-ac28ff310376 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:06.410647 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbb9b4-a613-4252-8dd2-ac28ff310376 service nova] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:06.410933 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbb9b4-a613-4252-8dd2-ac28ff310376 service nova] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:06.411211 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebbb9b4-a613-4252-8dd2-ac28ff310376 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:06.421229 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbb9b4-a613-4252-8dd2-ac28ff310376 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:06.422819 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebbb9b4-a613-4252-8dd2-ac28ff310376 service nova] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:06.433424 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 501/1003] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:08.966528 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1de38-c2eb-458c-b768-15877d0dd149 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:08.967066 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1de38-c2eb-458c-b768-15877d0dd149 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:08.967248 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f1de38-c2eb-458c-b768-15877d0dd149 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:08.968737 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 503/1004] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:08.974794 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18f73d-88dc-404d-a417-cc23ca899abf None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:08.975234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18f73d-88dc-404d-a417-cc23ca899abf None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:08.975359 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e18f73d-88dc-404d-a417-cc23ca899abf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:08.993619 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-7e18f73d-88dc-404d-a417-cc23ca899abf None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:08.994820 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-7e18f73d-88dc-404d-a417-cc23ca899abf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:09.003289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 502/1005] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:02:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:09.048444 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1de38-c2eb-458c-b768-15877d0dd149 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:09.062654 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f1de38-c2eb-458c-b768-15877d0dd149 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:09.068939 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523deaee-49d9-400a-ac73-ffaea2e031ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:09.069728 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523deaee-49d9-400a-ac73-ffaea2e031ea service nova] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:09.070113 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523deaee-49d9-400a-ac73-ffaea2e031ea service nova] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:09.070579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523deaee-49d9-400a-ac73-ffaea2e031ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:09.080075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523deaee-49d9-400a-ac73-ffaea2e031ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:09.081841 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523deaee-49d9-400a-ac73-ffaea2e031ea service nova] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:09.093481 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 504/1006] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:11.401375 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd641e-7923-4420-90df-65c5de053cdb None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:11.401909 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd641e-7923-4420-90df-65c5de053cdb None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:11.401909 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bd641e-7923-4420-90df-65c5de053cdb None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:11.403325 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 503/1007] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:02:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:11.408574 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83cef9-cac4-4e9b-aea8-c5094c671c33 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:11.409008 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83cef9-cac4-4e9b-aea8-c5094c671c33 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:11.409188 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a83cef9-cac4-4e9b-aea8-c5094c671c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:11.428358 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-2a83cef9-cac4-4e9b-aea8-c5094c671c33 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:11.429597 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-2a83cef9-cac4-4e9b-aea8-c5094c671c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:11.438031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 505/1008] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:02:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 13:02:11.482831 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd641e-7923-4420-90df-65c5de053cdb None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:11.498029 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bd641e-7923-4420-90df-65c5de053cdb None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:11.502911 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180ffdda-e9a5-40b3-a7c8-e91b675c5f6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:11.503547 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ffdda-e9a5-40b3-a7c8-e91b675c5f6b service nova] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:11.503829 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ffdda-e9a5-40b3-a7c8-e91b675c5f6b service nova] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:11.504106 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180ffdda-e9a5-40b3-a7c8-e91b675c5f6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:11.513351 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ffdda-e9a5-40b3-a7c8-e91b675c5f6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:11.514994 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180ffdda-e9a5-40b3-a7c8-e91b675c5f6b service nova] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:11.526294 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 504/1009] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:14.486246 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d79479-93e9-4269-a5b8-0b523204e146 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:14.505021 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d79479-93e9-4269-a5b8-0b523204e146 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:14.505021 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d79479-93e9-4269-a5b8-0b523204e146 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:14.505021 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 506/1010] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:02:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:14.505871 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812100b7-bbac-4c27-89a7-f4c3140bf29a None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:14.505871 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812100b7-bbac-4c27-89a7-f4c3140bf29a None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:14.505871 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812100b7-bbac-4c27-89a7-f4c3140bf29a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:14.523573 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-812100b7-bbac-4c27-89a7-f4c3140bf29a None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:14.524820 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-812100b7-bbac-4c27-89a7-f4c3140bf29a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:14.535973 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 505/1011] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:02:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:14.601560 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d79479-93e9-4269-a5b8-0b523204e146 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:14.605148 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d79479-93e9-4269-a5b8-0b523204e146 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:14.613132 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd720f6b-e3b4-472e-a3fc-4e9fd7c7d14f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:14.614056 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd720f6b-e3b4-472e-a3fc-4e9fd7c7d14f service nova] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:14.614269 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd720f6b-e3b4-472e-a3fc-4e9fd7c7d14f service nova] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:14.614427 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd720f6b-e3b4-472e-a3fc-4e9fd7c7d14f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:14.624024 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd720f6b-e3b4-472e-a3fc-4e9fd7c7d14f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:14.625725 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd720f6b-e3b4-472e-a3fc-4e9fd7c7d14f service nova] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:14.636558 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 507/1012] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:14 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 13:02:18.623473 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bd355-7085-4fb9-ba1b-f85ce007ea30 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:18.632443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bd355-7085-4fb9-ba1b-f85ce007ea30 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:18.632443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bd355-7085-4fb9-ba1b-f85ce007ea30 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:18.632443 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 506/1013] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:02:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:18.632777 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0419b5-e75d-4472-8323-ed0af8efc4d3 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:18.632777 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0419b5-e75d-4472-8323-ed0af8efc4d3 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:18.632777 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0419b5-e75d-4472-8323-ed0af8efc4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:18.650434 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-5f0419b5-e75d-4472-8323-ed0af8efc4d3 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:18.651610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-5f0419b5-e75d-4472-8323-ed0af8efc4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:18.659381 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 508/1014] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:02:18 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:18.707989 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341bd355-7085-4fb9-ba1b-f85ce007ea30 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:18.715782 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=46 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:02:18.722504 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341bd355-7085-4fb9-ba1b-f85ce007ea30 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:18.727624 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f1b18-f36a-47bd-81c7-41105e03ac6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:18.728303 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f1b18-f36a-47bd-81c7-41105e03ac6c service nova] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:18.728592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f1b18-f36a-47bd-81c7-41105e03ac6c service nova] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:18.728905 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f1b18-f36a-47bd-81c7-41105e03ac6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:18.737547 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f1b18-f36a-47bd-81c7-41105e03ac6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:18.739128 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f1b18-f36a-47bd-81c7-41105e03ac6c service nova] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:18.749438 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 507/1015] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:18 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:19.817269 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732c741-d997-4262-be7c-3b1bbfd21f8a None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:19.818438 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732c741-d997-4262-be7c-3b1bbfd21f8a None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:19.818438 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0732c741-d997-4262-be7c-3b1bbfd21f8a None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:19.819987 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 509/1016] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:02:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:19.825117 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccabca6-ac89-4dba-9196-719363066046 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:19.825584 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccabca6-ac89-4dba-9196-719363066046 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:19.825674 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccabca6-ac89-4dba-9196-719363066046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:19.843800 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-eccabca6-ac89-4dba-9196-719363066046 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:19.845278 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-eccabca6-ac89-4dba-9196-719363066046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:19.853166 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 508/1017] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:02:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:19.910684 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554ae1e-25b6-49e5-b280-4d45e78b98c5 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:19.910978 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554ae1e-25b6-49e5-b280-4d45e78b98c5 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:19.911257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554ae1e-25b6-49e5-b280-4d45e78b98c5 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:19.912720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 510/1018] 10.222.0.40 () {54 vars in 962 bytes} [Thu Jul 14 13:02:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:19.917972 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a749f-e2d2-42c1-9840-f80bc1c0cfdc None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:19.918267 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a749f-e2d2-42c1-9840-f80bc1c0cfdc None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:19.918552 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205a749f-e2d2-42c1-9840-f80bc1c0cfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:19.967750 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-205a749f-e2d2-42c1-9840-f80bc1c0cfdc None None] MFA Rules not processed for user `b8ba3c2afa1e4499bafda337dc4dc2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:19.969080 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-205a749f-e2d2-42c1-9840-f80bc1c0cfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:20.029587 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 509/1019] 10.222.0.40 () {58 vars in 1059 bytes} [Thu Jul 14 13:02:19 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:20.036915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554ae1e-25b6-49e5-b280-4d45e78b98c5 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:20.048237 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554ae1e-25b6-49e5-b280-4d45e78b98c5 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:20.052882 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bcbb05-590d-432f-8da9-7554a8e4fdea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8ba3c2afa1e4499bafda337dc4dc2a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:20.053557 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcbb05-590d-432f-8da9-7554a8e4fdea service glance] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:20.053838 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcbb05-590d-432f-8da9-7554a8e4fdea service glance] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:20.054115 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bcbb05-590d-432f-8da9-7554a8e4fdea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:20.069636 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcbb05-590d-432f-8da9-7554a8e4fdea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:20.070965 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bcbb05-590d-432f-8da9-7554a8e4fdea service glance] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:20.084200 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 511/1020] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:21.191106 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3113c-a8e1-48e5-abca-0daab4b69c11 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:21.191786 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3113c-a8e1-48e5-abca-0daab4b69c11 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:21.191786 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa3113c-a8e1-48e5-abca-0daab4b69c11 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:21.195712 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 510/1021] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:02:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:21.201544 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf34dd-cd0a-440d-8cea-5ec91294fa0e None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:21.202159 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf34dd-cd0a-440d-8cea-5ec91294fa0e None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:21.202159 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbf34dd-cd0a-440d-8cea-5ec91294fa0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:21.209768 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=100 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:02:21.220714 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-ddbf34dd-cd0a-440d-8cea-5ec91294fa0e None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:21.222364 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-ddbf34dd-cd0a-440d-8cea-5ec91294fa0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:21.230753 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 512/1022] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:02:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:21.277086 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3113c-a8e1-48e5-abca-0daab4b69c11 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:21.291350 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa3113c-a8e1-48e5-abca-0daab4b69c11 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:21.296451 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96829a8d-ed2f-4a03-8cdc-0c4ff389c211 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:21.297118 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96829a8d-ed2f-4a03-8cdc-0c4ff389c211 service nova] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:21.297412 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96829a8d-ed2f-4a03-8cdc-0c4ff389c211 service nova] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:21.297692 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96829a8d-ed2f-4a03-8cdc-0c4ff389c211 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:21.308194 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96829a8d-ed2f-4a03-8cdc-0c4ff389c211 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:21.308940 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96829a8d-ed2f-4a03-8cdc-0c4ff389c211 service nova] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:21.319158 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 511/1023] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:23.947628 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ed99c-13b9-4b3a-9b96-d5a7d9b47e6f None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:23.948283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ed99c-13b9-4b3a-9b96-d5a7d9b47e6f None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:23.948283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368ed99c-13b9-4b3a-9b96-d5a7d9b47e6f None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:23.949647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 513/1024] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:23.955115 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d818f5-5729-4432-83ee-fcf4633c00a4 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:23.955701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d818f5-5729-4432-83ee-fcf4633c00a4 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:23.955701 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d818f5-5729-4432-83ee-fcf4633c00a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:23.974266 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-c0d818f5-5729-4432-83ee-fcf4633c00a4 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:23.975487 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-c0d818f5-5729-4432-83ee-fcf4633c00a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:23.983519 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 512/1025] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:02:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 13:02:24.029687 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ed99c-13b9-4b3a-9b96-d5a7d9b47e6f None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:24.043792 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368ed99c-13b9-4b3a-9b96-d5a7d9b47e6f None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:24.048794 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c6b3e-b814-4a08-ae11-eb5ffba373fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:24.049439 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c6b3e-b814-4a08-ae11-eb5ffba373fd service nova] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:24.049721 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c6b3e-b814-4a08-ae11-eb5ffba373fd service nova] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:24.049998 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c6b3e-b814-4a08-ae11-eb5ffba373fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:24.059724 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c6b3e-b814-4a08-ae11-eb5ffba373fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:24.061390 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c6b3e-b814-4a08-ae11-eb5ffba373fd service nova] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:24.071994 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 514/1026] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:33.968433 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=55 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:02:34.066855 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=7 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:02:36.350158 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed338fb9-daa5-4b07-88f4-c802f3fc72d8 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:36.350778 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed338fb9-daa5-4b07-88f4-c802f3fc72d8 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:36.350778 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed338fb9-daa5-4b07-88f4-c802f3fc72d8 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:36.352125 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 513/1027] 10.222.0.40 () {54 vars in 918 bytes} [Thu Jul 14 13:02:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:36.357257 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1d2fd-8739-49a6-984e-f217ad38859f None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:36.369780 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1d2fd-8739-49a6-984e-f217ad38859f None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:36.369780 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed1d2fd-8739-49a6-984e-f217ad38859f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:36.388179 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-aed1d2fd-8739-49a6-984e-f217ad38859f None None] MFA Rules not processed for user `ee845fa8cb614ce183d4608e63c3e2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:36.389361 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-aed1d2fd-8739-49a6-984e-f217ad38859f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:36.397857 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 515/1028] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Jul 14 13:02:36 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:36.412510 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef33a2e-6d2a-499b-b5aa-c5b3618d6931 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:36.412839 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef33a2e-6d2a-499b-b5aa-c5b3618d6931 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:36.413125 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef33a2e-6d2a-499b-b5aa-c5b3618d6931 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:36.414500 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 514/1029] 10.222.0.40 () {54 vars in 918 bytes} [Thu Jul 14 13:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:36.419083 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8e15c-ad3f-45f8-b474-1ceb381a7780 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:36.419368 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8e15c-ad3f-45f8-b474-1ceb381a7780 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:36.419649 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e8e15c-ad3f-45f8-b474-1ceb381a7780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:36.437494 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-21e8e15c-ad3f-45f8-b474-1ceb381a7780 None None] MFA Rules not processed for user `1faa19de04744a4084a9c60c4af64f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:36.438673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-21e8e15c-ad3f-45f8-b474-1ceb381a7780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:36.447777 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 516/1030] 10.222.0.40 () {58 vars in 1015 bytes} [Thu Jul 14 13:02:36 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:39.209145 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8e167-3b75-4077-a942-abe254195b82 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:39.209904 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8e167-3b75-4077-a942-abe254195b82 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:39.209904 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8e167-3b75-4077-a942-abe254195b82 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:39.211032 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 515/1031] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 13:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:39.216364 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03887159-7c20-4a3e-ac17-97f66f5e49ba None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:39.216896 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03887159-7c20-4a3e-ac17-97f66f5e49ba None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:39.217005 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03887159-7c20-4a3e-ac17-97f66f5e49ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:39.235734 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-03887159-7c20-4a3e-ac17-97f66f5e49ba None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:39.236983 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-03887159-7c20-4a3e-ac17-97f66f5e49ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:39.245505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 517/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 13:02:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:39.288704 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8e167-3b75-4077-a942-abe254195b82 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:39.301891 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8e167-3b75-4077-a942-abe254195b82 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:39.307694 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f751eec-4642-4833-aea2-eb8f0f96d6db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:39.308322 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f751eec-4642-4833-aea2-eb8f0f96d6db service nova] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:39.308658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f751eec-4642-4833-aea2-eb8f0f96d6db service nova] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:39.308936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f751eec-4642-4833-aea2-eb8f0f96d6db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:39.317110 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f751eec-4642-4833-aea2-eb8f0f96d6db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:39.318748 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f751eec-4642-4833-aea2-eb8f0f96d6db service nova] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:39.328004 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 516/1033] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:40.305824 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f04336-2593-4235-ad71-d0e7e3849034 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:40.306387 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f04336-2593-4235-ad71-d0e7e3849034 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:40.306387 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f04336-2593-4235-ad71-d0e7e3849034 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:40.308146 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 518/1034] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 13:02:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:40.313285 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2ec3f-91f8-41dd-a725-994c2b2b2aee None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:40.313750 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2ec3f-91f8-41dd-a725-994c2b2b2aee None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:40.313853 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca2ec3f-91f8-41dd-a725-994c2b2b2aee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:40.332053 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-0ca2ec3f-91f8-41dd-a725-994c2b2b2aee None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:40.333273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-0ca2ec3f-91f8-41dd-a725-994c2b2b2aee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:40.341485 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 517/1035] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 13:02:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:40.554608 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f04336-2593-4235-ad71-d0e7e3849034 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:40.568614 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f04336-2593-4235-ad71-d0e7e3849034 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:40.573606 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c15a4b-5d22-404f-9900-770d2657db45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:40.574246 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c15a4b-5d22-404f-9900-770d2657db45 service nova] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:40.574532 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c15a4b-5d22-404f-9900-770d2657db45 service nova] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:40.574834 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c15a4b-5d22-404f-9900-770d2657db45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:40.583234 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c15a4b-5d22-404f-9900-770d2657db45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:40.584920 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c15a4b-5d22-404f-9900-770d2657db45 service nova] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:40.595096 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 519/1036] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:41.511854 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6568b-e3f6-45c9-bf2a-373852ce7078 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:41.512425 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6568b-e3f6-45c9-bf2a-373852ce7078 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:41.512425 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6568b-e3f6-45c9-bf2a-373852ce7078 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:41.513816 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 518/1037] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 13:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:41.518740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2eb288-63a3-47ab-a8a4-eb19e8a54af4 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:41.519157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2eb288-63a3-47ab-a8a4-eb19e8a54af4 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:41.519307 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2eb288-63a3-47ab-a8a4-eb19e8a54af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:41.537705 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-3c2eb288-63a3-47ab-a8a4-eb19e8a54af4 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:41.538901 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-3c2eb288-63a3-47ab-a8a4-eb19e8a54af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:41.546606 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 520/1038] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 13:02:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:41.701800 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6568b-e3f6-45c9-bf2a-373852ce7078 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:41.715548 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6568b-e3f6-45c9-bf2a-373852ce7078 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:41.720819 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110e88d-9158-4384-b05b-ec1664b1aa2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:41.721456 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110e88d-9158-4384-b05b-ec1664b1aa2d service nova] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:41.721739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110e88d-9158-4384-b05b-ec1664b1aa2d service nova] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:41.722014 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110e88d-9158-4384-b05b-ec1664b1aa2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:41.730173 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110e88d-9158-4384-b05b-ec1664b1aa2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:41.731759 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110e88d-9158-4384-b05b-ec1664b1aa2d service nova] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:41.741608 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 519/1039] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:42.650139 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d1f64-64c8-46be-8c8d-ecc42450ad6e None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:42.650709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d1f64-64c8-46be-8c8d-ecc42450ad6e None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:42.650709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271d1f64-64c8-46be-8c8d-ecc42450ad6e None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:42.652076 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 521/1040] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 13:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:42.657139 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bee3f-66a2-4130-ac32-f99b3eef9290 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:42.657554 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bee3f-66a2-4130-ac32-f99b3eef9290 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:42.657696 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71bee3f-66a2-4130-ac32-f99b3eef9290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:42.676242 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-f71bee3f-66a2-4130-ac32-f99b3eef9290 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:42.678017 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-f71bee3f-66a2-4130-ac32-f99b3eef9290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:42.685898 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 520/1041] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 13:02:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:42.842279 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d1f64-64c8-46be-8c8d-ecc42450ad6e None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:42.856451 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271d1f64-64c8-46be-8c8d-ecc42450ad6e None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:42.861539 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d068f4-4129-4b07-9921-d8da01635fb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:42.862179 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d068f4-4129-4b07-9921-d8da01635fb0 service nova] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:42.862471 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d068f4-4129-4b07-9921-d8da01635fb0 service nova] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:42.862748 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d068f4-4129-4b07-9921-d8da01635fb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:42.872119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d068f4-4129-4b07-9921-d8da01635fb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:42.873770 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d068f4-4129-4b07-9921-d8da01635fb0 service nova] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:42.883849 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 522/1042] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:43.759876 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e39977-6fc0-4329-9900-f89f21592809 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:43.760423 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e39977-6fc0-4329-9900-f89f21592809 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:43.760423 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e39977-6fc0-4329-9900-f89f21592809 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:43.761828 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 521/1043] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 13:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:43.766810 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5beffc-5582-4332-ade5-a2e77d415082 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:43.767210 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5beffc-5582-4332-ade5-a2e77d415082 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:43.767374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5beffc-5582-4332-ade5-a2e77d415082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:43.787123 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-cb5beffc-5582-4332-ade5-a2e77d415082 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:43.788310 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-cb5beffc-5582-4332-ade5-a2e77d415082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:43.796040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 523/1044] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 13:02:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:43.950405 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e39977-6fc0-4329-9900-f89f21592809 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:43.965064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e39977-6fc0-4329-9900-f89f21592809 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:43.970188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999852a0-c3b5-49da-a4e0-70a0a58a7a27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:43.970815 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999852a0-c3b5-49da-a4e0-70a0a58a7a27 service nova] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:43.971096 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999852a0-c3b5-49da-a4e0-70a0a58a7a27 service nova] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:43.971367 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999852a0-c3b5-49da-a4e0-70a0a58a7a27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:43.979434 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999852a0-c3b5-49da-a4e0-70a0a58a7a27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:43.981041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999852a0-c3b5-49da-a4e0-70a0a58a7a27 service nova] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:43.990849 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 522/1045] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:44.897873 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920dbe7b-9dbc-48ec-ab93-6551f852c30f None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:44.898442 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920dbe7b-9dbc-48ec-ab93-6551f852c30f None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:44.898442 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920dbe7b-9dbc-48ec-ab93-6551f852c30f None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:44.899807 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 524/1046] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 13:02:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:44.904932 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e58c7-39df-4334-aee2-df1875432f3f None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:44.905364 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e58c7-39df-4334-aee2-df1875432f3f None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:44.905497 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8e58c7-39df-4334-aee2-df1875432f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:44.923273 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-1c8e58c7-39df-4334-aee2-df1875432f3f None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:44.924955 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-1c8e58c7-39df-4334-aee2-df1875432f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:44.932903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 523/1047] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 13:02:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:45.089922 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920dbe7b-9dbc-48ec-ab93-6551f852c30f None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:45.103873 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920dbe7b-9dbc-48ec-ab93-6551f852c30f None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:45.108624 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3dbc0-1801-43bc-9ccd-1ce47580ec1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:45.109324 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3dbc0-1801-43bc-9ccd-1ce47580ec1c service nova] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:45.109567 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3dbc0-1801-43bc-9ccd-1ce47580ec1c service nova] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:45.109846 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3dbc0-1801-43bc-9ccd-1ce47580ec1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:45.118698 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3dbc0-1801-43bc-9ccd-1ce47580ec1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:45.120273 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3dbc0-1801-43bc-9ccd-1ce47580ec1c service nova] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:45.129582 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 525/1048] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:45.985245 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d6343-8619-46ad-90a5-52dfae523421 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:45.985792 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d6343-8619-46ad-90a5-52dfae523421 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:45.985792 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08d6343-8619-46ad-90a5-52dfae523421 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:45.987153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 524/1049] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 13:02:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:45.992477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56508f-c9c1-4538-b767-3facbaa58846 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:45.992987 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56508f-c9c1-4538-b767-3facbaa58846 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:45.993124 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56508f-c9c1-4538-b767-3facbaa58846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:46.011655 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-7e56508f-c9c1-4538-b767-3facbaa58846 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:46.012948 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-7e56508f-c9c1-4538-b767-3facbaa58846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:46.022057 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 526/1050] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 13:02:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:46.177637 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d6343-8619-46ad-90a5-52dfae523421 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:46.190830 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08d6343-8619-46ad-90a5-52dfae523421 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:46.196223 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a5b0e-d58c-4c4f-8d3c-d411dccaa0f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:46.196878 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a5b0e-d58c-4c4f-8d3c-d411dccaa0f7 service nova] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:46.197513 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a5b0e-d58c-4c4f-8d3c-d411dccaa0f7 service nova] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:46.197513 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a5b0e-d58c-4c4f-8d3c-d411dccaa0f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:46.205430 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a5b0e-d58c-4c4f-8d3c-d411dccaa0f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:46.207012 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a5b0e-d58c-4c4f-8d3c-d411dccaa0f7 service nova] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:46.216940 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 525/1051] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:47.084954 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a3a0c-e9ad-408d-9ce9-aa2a3b44d1ed None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:47.085525 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a3a0c-e9ad-408d-9ce9-aa2a3b44d1ed None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:47.085525 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a3a0c-e9ad-408d-9ce9-aa2a3b44d1ed None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:47.087426 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 527/1052] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 13:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:47.092340 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04072b-2149-415a-aed4-cc9469a5b5f5 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:47.092815 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04072b-2149-415a-aed4-cc9469a5b5f5 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:47.092920 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04072b-2149-415a-aed4-cc9469a5b5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:47.110812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-4d04072b-2149-415a-aed4-cc9469a5b5f5 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:47.112007 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-4d04072b-2149-415a-aed4-cc9469a5b5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:47.120397 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 526/1053] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 13:02:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:47.276122 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a3a0c-e9ad-408d-9ce9-aa2a3b44d1ed None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:47.289692 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a3a0c-e9ad-408d-9ce9-aa2a3b44d1ed None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:47.294592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7a99d-1135-4ba4-b905-236680e142ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:47.295228 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7a99d-1135-4ba4-b905-236680e142ee service nova] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:47.295517 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7a99d-1135-4ba4-b905-236680e142ee service nova] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:47.295797 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7a99d-1135-4ba4-b905-236680e142ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:47.304331 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7a99d-1135-4ba4-b905-236680e142ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:47.305968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7a99d-1135-4ba4-b905-236680e142ee service nova] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:47.315211 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 528/1054] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:48.214417 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43fcd3-f46a-4cca-aa86-5b4b230abdce None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:48.214949 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43fcd3-f46a-4cca-aa86-5b4b230abdce None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:48.215043 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43fcd3-f46a-4cca-aa86-5b4b230abdce None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:48.216367 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 527/1055] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 13:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:48.221933 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3266ff-6eed-4588-8577-a69255f88205 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:48.222328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3266ff-6eed-4588-8577-a69255f88205 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:48.222518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3266ff-6eed-4588-8577-a69255f88205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:48.241432 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-9a3266ff-6eed-4588-8577-a69255f88205 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:48.242619 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-9a3266ff-6eed-4588-8577-a69255f88205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:48.250507 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 529/1056] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 13:02:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:48.404115 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43fcd3-f46a-4cca-aa86-5b4b230abdce None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:48.417927 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43fcd3-f46a-4cca-aa86-5b4b230abdce None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:48.422896 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb4a91-c56e-45ea-b73a-a41fa674c97a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:48.423525 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb4a91-c56e-45ea-b73a-a41fa674c97a service nova] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:48.423812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb4a91-c56e-45ea-b73a-a41fa674c97a service nova] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:48.424089 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb4a91-c56e-45ea-b73a-a41fa674c97a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:48.432856 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb4a91-c56e-45ea-b73a-a41fa674c97a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:48.434438 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb4a91-c56e-45ea-b73a-a41fa674c97a service nova] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:48.443919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 528/1057] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:50.607938 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492a89e-6086-4c2e-950e-b452c499c384 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:50.608476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492a89e-6086-4c2e-950e-b452c499c384 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:50.608476 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5492a89e-6086-4c2e-950e-b452c499c384 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:50.609917 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 530/1058] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 13:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:50.615912 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f11662-1396-4c03-bdfd-fcfc80438870 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:50.616386 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f11662-1396-4c03-bdfd-fcfc80438870 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:50.616492 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f11662-1396-4c03-bdfd-fcfc80438870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:50.634042 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-11f11662-1396-4c03-bdfd-fcfc80438870 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:50.635280 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-11f11662-1396-4c03-bdfd-fcfc80438870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:50.642909 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 529/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 13:02:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:50.682787 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492a89e-6086-4c2e-950e-b452c499c384 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:50.693267 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5492a89e-6086-4c2e-950e-b452c499c384 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:50.696711 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee7ee73-da82-4164-884b-ceb0772a2ab3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:50.697337 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7ee73-da82-4164-884b-ceb0772a2ab3 service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:50.697617 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7ee73-da82-4164-884b-ceb0772a2ab3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:50.697888 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee7ee73-da82-4164-884b-ceb0772a2ab3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:50.706769 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7ee73-da82-4164-884b-ceb0772a2ab3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:50.708200 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee7ee73-da82-4164-884b-ceb0772a2ab3 service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:50.718186 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 531/1060] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:53.113022 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c96ae-30fd-4a47-b9ad-5b7151af259c None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:53.113604 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c96ae-30fd-4a47-b9ad-5b7151af259c None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:53.113604 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870c96ae-30fd-4a47-b9ad-5b7151af259c None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:53.115451 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 530/1061] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 13:02:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:53.120823 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dab0a-1963-401d-b07d-cab7bc79bed7 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:53.121235 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dab0a-1963-401d-b07d-cab7bc79bed7 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:53.121389 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327dab0a-1963-401d-b07d-cab7bc79bed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:53.140426 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-327dab0a-1963-401d-b07d-cab7bc79bed7 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:53.141667 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-327dab0a-1963-401d-b07d-cab7bc79bed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:53.149526 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 532/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 13:02:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:53.188295 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c96ae-30fd-4a47-b9ad-5b7151af259c None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:53.199435 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870c96ae-30fd-4a47-b9ad-5b7151af259c None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:53.202964 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23005b-7719-430e-a79b-0a55cc2da845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:53.203607 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23005b-7719-430e-a79b-0a55cc2da845 service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:53.203874 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23005b-7719-430e-a79b-0a55cc2da845 service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:53.204153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23005b-7719-430e-a79b-0a55cc2da845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:53.213012 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23005b-7719-430e-a79b-0a55cc2da845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:53.214437 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23005b-7719-430e-a79b-0a55cc2da845 service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:53.223935 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 531/1063] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:55.855474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4143d-ab18-469f-9d12-ef6b9600f89e None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:55.856012 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4143d-ab18-469f-9d12-ef6b9600f89e None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:55.856012 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b4143d-ab18-469f-9d12-ef6b9600f89e None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:55.857430 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 533/1064] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 13:02:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:55.862596 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06fbdd-e7fb-4698-b1db-710a2fc3c645 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:55.863034 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06fbdd-e7fb-4698-b1db-710a2fc3c645 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:55.863161 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06fbdd-e7fb-4698-b1db-710a2fc3c645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:55.881442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-cf06fbdd-e7fb-4698-b1db-710a2fc3c645 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:55.882634 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-cf06fbdd-e7fb-4698-b1db-710a2fc3c645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:55.890374 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 532/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 13:02:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:55.930546 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4143d-ab18-469f-9d12-ef6b9600f89e None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:55.941594 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b4143d-ab18-469f-9d12-ef6b9600f89e None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:55.945074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246acb2a-e4c4-45ef-a959-6659e76eeccd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:55.945700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246acb2a-e4c4-45ef-a959-6659e76eeccd service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:55.945981 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246acb2a-e4c4-45ef-a959-6659e76eeccd service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:55.946256 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246acb2a-e4c4-45ef-a959-6659e76eeccd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:55.955063 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246acb2a-e4c4-45ef-a959-6659e76eeccd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:55.956490 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246acb2a-e4c4-45ef-a959-6659e76eeccd service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:55.966300 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 534/1066] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:02:58.355705 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8c631-3e14-4121-ab6c-9c6ced4d59e1 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:58.356286 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8c631-3e14-4121-ab6c-9c6ced4d59e1 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:58.356286 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde8c631-3e14-4121-ab6c-9c6ced4d59e1 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:58.357700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 533/1067] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 13:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:02:58.362994 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ac41a-1ff8-433d-83c6-ef36b3fb246b None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:58.363406 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ac41a-1ff8-433d-83c6-ef36b3fb246b None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:58.363559 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60ac41a-1ff8-433d-83c6-ef36b3fb246b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:58.382237 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-e60ac41a-1ff8-433d-83c6-ef36b3fb246b None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:02:58.383432 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-e60ac41a-1ff8-433d-83c6-ef36b3fb246b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:02:58.391355 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 535/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 13:02:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:02:58.430690 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8c631-3e14-4121-ab6c-9c6ced4d59e1 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:02:58.442503 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde8c631-3e14-4121-ab6c-9c6ced4d59e1 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:02:58.446773 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6f9a7-8ce0-4968-bd23-fb5c32da2c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:02:58.447441 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6f9a7-8ce0-4968-bd23-fb5c32da2c43 service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:02:58.447726 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6f9a7-8ce0-4968-bd23-fb5c32da2c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:02:58.448059 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6f9a7-8ce0-4968-bd23-fb5c32da2c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:02:58.457429 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6f9a7-8ce0-4968-bd23-fb5c32da2c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:02:58.458869 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb6f9a7-8ce0-4968-bd23-fb5c32da2c43 service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:02:58.468920 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 534/1069] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:02:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:03:00.805549 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca28e0-42aa-442b-834c-9905768a89e2 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:00.806089 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca28e0-42aa-442b-834c-9905768a89e2 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:00.806089 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca28e0-42aa-442b-834c-9905768a89e2 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:00.807833 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 536/1070] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 13:03:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:03:00.813625 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a17331-9291-4109-8cbd-8b2525f02cff None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:00.814083 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a17331-9291-4109-8cbd-8b2525f02cff None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:00.814180 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a17331-9291-4109-8cbd-8b2525f02cff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:00.832268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-f6a17331-9291-4109-8cbd-8b2525f02cff None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:03:00.833498 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-f6a17331-9291-4109-8cbd-8b2525f02cff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:03:00.841212 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 535/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 13:03:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:03:00.881702 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca28e0-42aa-442b-834c-9905768a89e2 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:03:00.892426 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca28e0-42aa-442b-834c-9905768a89e2 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:03:00.895901 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad40895e-8972-4509-a22c-b7c6716dedd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:03:00.896535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40895e-8972-4509-a22c-b7c6716dedd3 service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:00.896860 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40895e-8972-4509-a22c-b7c6716dedd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:00.897141 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad40895e-8972-4509-a22c-b7c6716dedd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:00.906088 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40895e-8972-4509-a22c-b7c6716dedd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:03:00.907530 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad40895e-8972-4509-a22c-b7c6716dedd3 service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:03:00.917495 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 537/1072] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:03:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:03:03.262689 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0e4bd-c0c2-4a0a-87c6-0f4f69353494 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:03.263246 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0e4bd-c0c2-4a0a-87c6-0f4f69353494 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:03.263246 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf0e4bd-c0c2-4a0a-87c6-0f4f69353494 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:03.264604 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 536/1073] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 13:03:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:03:03.269903 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a6867-94cd-4e05-b24b-e30a0bcc0897 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:03.270313 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a6867-94cd-4e05-b24b-e30a0bcc0897 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:03.270474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a6867-94cd-4e05-b24b-e30a0bcc0897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:03.288394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-d29a6867-94cd-4e05-b24b-e30a0bcc0897 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:03:03.289625 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-d29a6867-94cd-4e05-b24b-e30a0bcc0897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:03:03.297399 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 538/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 13:03:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 13:03:03.335920 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0e4bd-c0c2-4a0a-87c6-0f4f69353494 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:03:03.347206 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf0e4bd-c0c2-4a0a-87c6-0f4f69353494 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:03:03.351234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ab8bbf-491e-4b76-8bda-edba1b5e72f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:03:03.351863 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab8bbf-491e-4b76-8bda-edba1b5e72f1 service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:03.352149 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab8bbf-491e-4b76-8bda-edba1b5e72f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:03.352427 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ab8bbf-491e-4b76-8bda-edba1b5e72f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:03.361243 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab8bbf-491e-4b76-8bda-edba1b5e72f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:03:03.362667 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ab8bbf-491e-4b76-8bda-edba1b5e72f1 service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:03:03.372626 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 537/1075] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:03:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:03:05.683155 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec37c9-120e-4453-b75f-66845c3cfb1d None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:05.684036 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec37c9-120e-4453-b75f-66845c3cfb1d None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:05.684329 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec37c9-120e-4453-b75f-66845c3cfb1d None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:05.685886 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 539/1076] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 13:03:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:03:05.691286 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d8228-a2d0-4c70-8414-fbdd26b1d0e1 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:05.691707 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d8228-a2d0-4c70-8414-fbdd26b1d0e1 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:05.691848 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d8228-a2d0-4c70-8414-fbdd26b1d0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:05.698034 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=70 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:03:05.710433 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-e70d8228-a2d0-4c70-8414-fbdd26b1d0e1 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:03:05.711636 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-e70d8228-a2d0-4c70-8414-fbdd26b1d0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:03:05.719656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 538/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 13:03:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:03:05.758834 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec37c9-120e-4453-b75f-66845c3cfb1d None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:03:05.764310 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=78 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:03:05.769975 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec37c9-120e-4453-b75f-66845c3cfb1d None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:03:05.774113 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5b0709-54d5-4b08-8187-7f83b3060fdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:03:05.774750 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b0709-54d5-4b08-8187-7f83b3060fdd service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:05.775040 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b0709-54d5-4b08-8187-7f83b3060fdd service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:05.775322 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5b0709-54d5-4b08-8187-7f83b3060fdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:05.784294 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b0709-54d5-4b08-8187-7f83b3060fdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:03:05.785817 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5b0709-54d5-4b08-8187-7f83b3060fdd service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:03:05.800077 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 540/1078] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:03:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:03:08.173820 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c77c5f-3b1c-42e9-a453-577d14d05bd5 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:08.174509 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c77c5f-3b1c-42e9-a453-577d14d05bd5 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:08.174509 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c77c5f-3b1c-42e9-a453-577d14d05bd5 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:08.175771 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 539/1079] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 13:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:03:08.184284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a407a-9cb4-4b6d-9c2c-dee5ab4faaa6 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:08.184284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a407a-9cb4-4b6d-9c2c-dee5ab4faaa6 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:08.184284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556a407a-9cb4-4b6d-9c2c-dee5ab4faaa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:08.204808 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-556a407a-9cb4-4b6d-9c2c-dee5ab4faaa6 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:03:08.207293 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-556a407a-9cb4-4b6d-9c2c-dee5ab4faaa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:03:08.217650 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 541/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 13:03:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:03:08.264968 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c77c5f-3b1c-42e9-a453-577d14d05bd5 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:03:08.275485 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c77c5f-3b1c-42e9-a453-577d14d05bd5 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:03:08.278953 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a95df-d5bd-413d-8e96-ce063629adce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:03:08.279579 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a95df-d5bd-413d-8e96-ce063629adce service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:08.279860 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a95df-d5bd-413d-8e96-ce063629adce service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:08.280134 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a95df-d5bd-413d-8e96-ce063629adce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:08.289184 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a95df-d5bd-413d-8e96-ce063629adce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:03:08.290593 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8a95df-d5bd-413d-8e96-ce063629adce service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:03:08.299704 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 540/1081] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:03:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:03:10.576393 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a3ae5-39cf-41d4-a9ca-592cbe0e7245 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:10.578661 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a3ae5-39cf-41d4-a9ca-592cbe0e7245 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:10.578661 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45a3ae5-39cf-41d4-a9ca-592cbe0e7245 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:10.578661 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 542/1082] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 13:03:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:03:10.584403 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d893f9-2d50-4c89-bfb2-f59ca3a15819 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:10.584906 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d893f9-2d50-4c89-bfb2-f59ca3a15819 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:10.585030 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d893f9-2d50-4c89-bfb2-f59ca3a15819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:10.608616 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-04d893f9-2d50-4c89-bfb2-f59ca3a15819 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:03:10.610417 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-04d893f9-2d50-4c89-bfb2-f59ca3a15819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:03:10.621962 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 541/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 13:03:10 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:03:10.660609 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a3ae5-39cf-41d4-a9ca-592cbe0e7245 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:03:10.671431 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45a3ae5-39cf-41d4-a9ca-592cbe0e7245 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:03:10.674939 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f074e3-3854-4bf3-9351-259958eb5ac4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:03:10.675579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f074e3-3854-4bf3-9351-259958eb5ac4 service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:10.675864 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f074e3-3854-4bf3-9351-259958eb5ac4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:10.676143 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f074e3-3854-4bf3-9351-259958eb5ac4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:10.685324 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f074e3-3854-4bf3-9351-259958eb5ac4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:03:10.686819 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f074e3-3854-4bf3-9351-259958eb5ac4 service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:03:10.696999 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 543/1084] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:03:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:03:12.930827 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594955f-dffe-45e3-8559-49e70e4c53cb None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:12.931405 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594955f-dffe-45e3-8559-49e70e4c53cb None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:12.931405 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594955f-dffe-45e3-8559-49e70e4c53cb None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:12.932900 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 542/1085] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 13:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:03:12.938307 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658ff80-daf4-4262-958f-7fd2d21af48c None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:12.938757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658ff80-daf4-4262-958f-7fd2d21af48c None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:12.938889 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658ff80-daf4-4262-958f-7fd2d21af48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:12.956955 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-f658ff80-daf4-4262-958f-7fd2d21af48c None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:03:12.958158 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-f658ff80-daf4-4262-958f-7fd2d21af48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:03:12.965968 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 544/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 13:03:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:03:13.005385 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594955f-dffe-45e3-8559-49e70e4c53cb None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:03:13.016281 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594955f-dffe-45e3-8559-49e70e4c53cb None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:03:13.020390 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f49f73-c6df-4aae-ba5d-392e0a775a3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:03:13.021116 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f49f73-c6df-4aae-ba5d-392e0a775a3c service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:13.021476 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f49f73-c6df-4aae-ba5d-392e0a775a3c service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:13.021682 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f49f73-c6df-4aae-ba5d-392e0a775a3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:13.030921 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f49f73-c6df-4aae-ba5d-392e0a775a3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:03:13.032377 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f49f73-c6df-4aae-ba5d-392e0a775a3c service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:03:13.042789 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 543/1087] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:03:13 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:03:22.951724 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=17 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:03:23.038474 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=17 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:03:37.164401 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea626ba-0da3-490f-9d07-e39df8096e68 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:37.165072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea626ba-0da3-490f-9d07-e39df8096e68 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:37.165072 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea626ba-0da3-490f-9d07-e39df8096e68 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:37.166349 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 545/1088] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:03:37.171501 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908913b0-6084-48c6-855f-ebb945c8747f None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:37.172099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908913b0-6084-48c6-855f-ebb945c8747f None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:37.172099 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908913b0-6084-48c6-855f-ebb945c8747f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:37.192656 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-908913b0-6084-48c6-855f-ebb945c8747f None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:03:37.194422 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-908913b0-6084-48c6-855f-ebb945c8747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:03:37.204814 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 544/1089] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:03:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:03:37.254371 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd3f01-9a94-47d5-a0f8-edc52e53a270 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:37.254665 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd3f01-9a94-47d5-a0f8-edc52e53a270 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:37.254945 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bd3f01-9a94-47d5-a0f8-edc52e53a270 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:37.256975 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 546/1090] 10.222.0.40 () {54 vars in 962 bytes} [Thu Jul 14 13:03:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:03:37.262502 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19856b64-96db-4f8b-8d35-bfcea5dbf852 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:37.262798 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19856b64-96db-4f8b-8d35-bfcea5dbf852 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:37.263091 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19856b64-96db-4f8b-8d35-bfcea5dbf852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:37.280963 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-19856b64-96db-4f8b-8d35-bfcea5dbf852 None None] MFA Rules not processed for user `b8ba3c2afa1e4499bafda337dc4dc2a9`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:03:37.282137 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-19856b64-96db-4f8b-8d35-bfcea5dbf852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:03:37.288833 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 545/1091] 10.222.0.40 () {58 vars in 1059 bytes} [Thu Jul 14 13:03:37 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:03:37.295858 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd3f01-9a94-47d5-a0f8-edc52e53a270 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:03:37.307568 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bd3f01-9a94-47d5-a0f8-edc52e53a270 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:03:37.311047 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4dfb5-2d95-42b3-a66e-2e7ee0ddb5f7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8ba3c2afa1e4499bafda337dc4dc2a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:03:37.311668 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4dfb5-2d95-42b3-a66e-2e7ee0ddb5f7 service glance] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:37.311951 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4dfb5-2d95-42b3-a66e-2e7ee0ddb5f7 service glance] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:37.312227 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4dfb5-2d95-42b3-a66e-2e7ee0ddb5f7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:37.321588 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4dfb5-2d95-42b3-a66e-2e7ee0ddb5f7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:03:37.323008 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4dfb5-2d95-42b3-a66e-2e7ee0ddb5f7 service glance] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:03:37.332239 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 547/1092] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:03:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:03:39.677167 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272288a-58d9-4c3f-9892-f72fa9ebebd7 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:39.678242 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272288a-58d9-4c3f-9892-f72fa9ebebd7 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:39.678242 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272288a-58d9-4c3f-9892-f72fa9ebebd7 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:39.679620 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 546/1093] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:03:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:03:39.684909 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dcb89-88d6-40e4-a7ce-583e081e86d5 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:39.685345 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dcb89-88d6-40e4-a7ce-583e081e86d5 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:39.685489 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40dcb89-88d6-40e4-a7ce-583e081e86d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:39.703549 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-c40dcb89-88d6-40e4-a7ce-583e081e86d5 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:03:39.704789 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-c40dcb89-88d6-40e4-a7ce-583e081e86d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:03:39.712523 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 548/1094] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:03:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:03:39.736658 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272288a-58d9-4c3f-9892-f72fa9ebebd7 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:03:39.749726 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e272288a-58d9-4c3f-9892-f72fa9ebebd7 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:03:39.754162 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3984319f-b326-4ccd-9224-a6e3128c26c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:03:39.754811 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984319f-b326-4ccd-9224-a6e3128c26c2 admin admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:39.755125 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984319f-b326-4ccd-9224-a6e3128c26c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:39.755373 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3984319f-b326-4ccd-9224-a6e3128c26c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:39.756826 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984319f-b326-4ccd-9224-a6e3128c26c2 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:03:39.758579 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: WARNING py.warnings [None req-3984319f-b326-4ccd-9224-a6e3128c26c2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 13:03:39.758579 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: warnings.warn(msg) Jul 14 13:03:39.758579 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: Jul 14 13:03:39.759723 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3984319f-b326-4ccd-9224-a6e3128c26c2 admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:03:39.777842 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 547/1095] 10.222.0.40 () {56 vars in 1108 bytes} [Thu Jul 14 13:03:39 2022] GET /identity/v3/projects => generated 1606 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 13:03:42.036528 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70642a2f-f88e-4233-b301-7ff8c56612f6 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:42.037119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70642a2f-f88e-4233-b301-7ff8c56612f6 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:42.037229 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70642a2f-f88e-4233-b301-7ff8c56612f6 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:42.038527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 549/1096] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:03:42.043744 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ba00-8abd-4585-9447-9a408e52de92 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:42.044268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ba00-8abd-4585-9447-9a408e52de92 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:42.044387 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd76ba00-8abd-4585-9447-9a408e52de92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:42.063344 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-cd76ba00-8abd-4585-9447-9a408e52de92 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:03:42.064541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-cd76ba00-8abd-4585-9447-9a408e52de92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:03:42.072930 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 548/1097] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:03:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:03:42.117761 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70642a2f-f88e-4233-b301-7ff8c56612f6 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:03:42.131332 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70642a2f-f88e-4233-b301-7ff8c56612f6 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:03:42.137417 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0926ab36-d867-4ee2-ba57-bfa2ebf03599 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:03:42.138075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926ab36-d867-4ee2-ba57-bfa2ebf03599 service nova] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:42.138366 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926ab36-d867-4ee2-ba57-bfa2ebf03599 service nova] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:42.138699 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0926ab36-d867-4ee2-ba57-bfa2ebf03599 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:42.147758 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926ab36-d867-4ee2-ba57-bfa2ebf03599 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:03:42.149492 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0926ab36-d867-4ee2-ba57-bfa2ebf03599 service nova] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:03:42.159042 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 550/1098] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:03:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:03:44.587801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec5a06-7a34-4281-b048-fb5de4dbe6cf None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:44.588331 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec5a06-7a34-4281-b048-fb5de4dbe6cf None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:44.588331 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ec5a06-7a34-4281-b048-fb5de4dbe6cf None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:44.589822 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 549/1099] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:03:44.595051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53888c7-6f95-4259-a392-720177880ad4 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:44.595488 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53888c7-6f95-4259-a392-720177880ad4 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:44.595593 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53888c7-6f95-4259-a392-720177880ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:44.614111 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-c53888c7-6f95-4259-a392-720177880ad4 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:03:44.615970 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-c53888c7-6f95-4259-a392-720177880ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:03:44.623750 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 551/1100] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:03:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:03:44.660581 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec5a06-7a34-4281-b048-fb5de4dbe6cf None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:03:44.671877 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ec5a06-7a34-4281-b048-fb5de4dbe6cf None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:03:44.675345 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387c4fe-9644-442a-97ab-d9d1e6dcbe38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:03:44.675976 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387c4fe-9644-442a-97ab-d9d1e6dcbe38 service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:44.676259 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387c4fe-9644-442a-97ab-d9d1e6dcbe38 service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:44.676534 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387c4fe-9644-442a-97ab-d9d1e6dcbe38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:44.686971 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387c4fe-9644-442a-97ab-d9d1e6dcbe38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:03:44.688410 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387c4fe-9644-442a-97ab-d9d1e6dcbe38 service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:03:44.698963 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 550/1101] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:03:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:03:46.978674 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d70a9-155f-4d6a-b319-1a152c2cbc27 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:46.979218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d70a9-155f-4d6a-b319-1a152c2cbc27 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:46.979218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360d70a9-155f-4d6a-b319-1a152c2cbc27 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:46.980576 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 552/1102] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:03:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:03:46.985845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4ed54-53df-4e8a-8fc1-62d2a9b5348f None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:46.986298 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4ed54-53df-4e8a-8fc1-62d2a9b5348f None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:46.986466 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc4ed54-53df-4e8a-8fc1-62d2a9b5348f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:47.003696 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-abc4ed54-53df-4e8a-8fc1-62d2a9b5348f None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:03:47.004922 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-abc4ed54-53df-4e8a-8fc1-62d2a9b5348f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:03:47.012743 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 551/1103] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:03:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:03:47.053131 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d70a9-155f-4d6a-b319-1a152c2cbc27 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:03:47.063646 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360d70a9-155f-4d6a-b319-1a152c2cbc27 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:03:47.067088 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcca640-36c9-4511-b8ff-3e9d0ef8c3ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:03:47.067712 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcca640-36c9-4511-b8ff-3e9d0ef8c3ad service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:47.067999 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcca640-36c9-4511-b8ff-3e9d0ef8c3ad service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:47.068300 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcca640-36c9-4511-b8ff-3e9d0ef8c3ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:47.076945 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcca640-36c9-4511-b8ff-3e9d0ef8c3ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:03:47.078375 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcca640-36c9-4511-b8ff-3e9d0ef8c3ad service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:03:47.088275 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 553/1104] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:03:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:03:49.525548 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e3e99-f559-4164-b45f-b198d22a2065 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:49.526077 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e3e99-f559-4164-b45f-b198d22a2065 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:49.526077 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788e3e99-f559-4164-b45f-b198d22a2065 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:49.527436 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 552/1105] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:03:49.532592 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e358f28-7cb4-400e-a660-756e1cdfc793 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:49.533032 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e358f28-7cb4-400e-a660-756e1cdfc793 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:49.533225 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e358f28-7cb4-400e-a660-756e1cdfc793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:49.552470 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-5e358f28-7cb4-400e-a660-756e1cdfc793 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:03:49.554223 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-5e358f28-7cb4-400e-a660-756e1cdfc793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:03:49.562151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 554/1106] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:03:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:03:49.604569 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e3e99-f559-4164-b45f-b198d22a2065 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:03:49.615929 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788e3e99-f559-4164-b45f-b198d22a2065 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:03:49.619580 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae01423-4d1d-4fd4-bf37-35fdb195487f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:03:49.620221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae01423-4d1d-4fd4-bf37-35fdb195487f service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:49.620514 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae01423-4d1d-4fd4-bf37-35fdb195487f service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:49.620816 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae01423-4d1d-4fd4-bf37-35fdb195487f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:49.630327 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae01423-4d1d-4fd4-bf37-35fdb195487f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:03:49.631805 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae01423-4d1d-4fd4-bf37-35fdb195487f service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:03:49.641739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 553/1107] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:03:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:03:52.281928 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2419d63-abb6-4b48-acb8-e88230c7af96 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:52.282516 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2419d63-abb6-4b48-acb8-e88230c7af96 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:52.282516 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2419d63-abb6-4b48-acb8-e88230c7af96 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:52.283911 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 555/1108] 10.222.0.40 () {54 vars in 926 bytes} [Thu Jul 14 13:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:03:52.289328 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8bd3d-b299-4b74-be16-69d652f9d271 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:52.289774 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8bd3d-b299-4b74-be16-69d652f9d271 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:52.289916 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a8bd3d-b299-4b74-be16-69d652f9d271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:52.307951 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-f1a8bd3d-b299-4b74-be16-69d652f9d271 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:03:52.309190 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-f1a8bd3d-b299-4b74-be16-69d652f9d271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:03:52.316916 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 554/1109] 10.222.0.40 () {58 vars in 1023 bytes} [Thu Jul 14 13:03:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:03:52.357315 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2419d63-abb6-4b48-acb8-e88230c7af96 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:03:52.368814 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2419d63-abb6-4b48-acb8-e88230c7af96 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:03:52.372247 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd780b31-e5eb-45ad-82c9-751a9660757e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:03:52.373021 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd780b31-e5eb-45ad-82c9-751a9660757e service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:03:52.373308 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd780b31-e5eb-45ad-82c9-751a9660757e service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:03:52.373588 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd780b31-e5eb-45ad-82c9-751a9660757e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:03:52.383093 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd780b31-e5eb-45ad-82c9-751a9660757e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:03:52.384581 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd780b31-e5eb-45ad-82c9-751a9660757e service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:03:52.394455 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 556/1110] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:03:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:04:02.302238 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=33 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:04:02.390091 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=33 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:05:41.221513 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bfbe8-3de6-4595-a8d5-13dbf9d0527e None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:05:41.222123 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bfbe8-3de6-4595-a8d5-13dbf9d0527e None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:05:41.222123 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bfbe8-3de6-4595-a8d5-13dbf9d0527e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:05:41.240153 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-533bfbe8-3de6-4595-a8d5-13dbf9d0527e None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:05:41.241380 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-533bfbe8-3de6-4595-a8d5-13dbf9d0527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:05:41.249660 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 555/1111] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:05:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:05:41.257527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1817130-d0f2-4934-8594-4953dec93836 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:05:41.258065 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1817130-d0f2-4934-8594-4953dec93836 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:05:41.258065 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1817130-d0f2-4934-8594-4953dec93836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:05:41.276429 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-c1817130-d0f2-4934-8594-4953dec93836 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:05:41.279950 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-c1817130-d0f2-4934-8594-4953dec93836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:05:41.285441 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 557/1112] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:05:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:05:41.290456 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bfbe8-3de6-4595-a8d5-13dbf9d0527e None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:05:41.300233 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bfbe8-3de6-4595-a8d5-13dbf9d0527e None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:05:41.304920 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c290ab6-49fc-41ff-9134-859f4cd8d05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:05:41.306234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c290ab6-49fc-41ff-9134-859f4cd8d05e admin admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:05:41.306461 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c290ab6-49fc-41ff-9134-859f4cd8d05e admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:05:41.306737 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c290ab6-49fc-41ff-9134-859f4cd8d05e admin admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:05:41.307456 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c290ab6-49fc-41ff-9134-859f4cd8d05e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 13:05:41.307763 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c290ab6-49fc-41ff-9134-859f4cd8d05e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:05:41.308807 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: WARNING py.warnings [None req-7c290ab6-49fc-41ff-9134-859f4cd8d05e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 13:05:41.308807 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: warnings.warn(msg) Jul 14 13:05:41.308807 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: Jul 14 13:05:41.311845 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c290ab6-49fc-41ff-9134-859f4cd8d05e admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:05:41.321331 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 556/1113] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 13:05:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 13:05:41.329985 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1817130-d0f2-4934-8594-4953dec93836 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:05:41.339899 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1817130-d0f2-4934-8594-4953dec93836 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:05:41.349412 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab71a0-7a7a-49c4-82de-26f616ae23df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:05:41.350090 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab71a0-7a7a-49c4-82de-26f616ae23df admin admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:05:41.350377 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab71a0-7a7a-49c4-82de-26f616ae23df admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:05:41.350656 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bab71a0-7a7a-49c4-82de-26f616ae23df admin admin] PATH_INFO: `/v3/projects` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:05:41.354346 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab71a0-7a7a-49c4-82de-26f616ae23df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:05:41.356267 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: WARNING py.warnings [None req-8bab71a0-7a7a-49c4-82de-26f616ae23df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 13:05:41.356267 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: warnings.warn(msg) Jul 14 13:05:41.356267 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: Jul 14 13:05:41.357542 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bab71a0-7a7a-49c4-82de-26f616ae23df admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:05:41.476733 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 558/1114] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 13:05:41 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 13:05:41.481475 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c290ab6-49fc-41ff-9134-859f4cd8d05e admin admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:05:41.491878 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c290ab6-49fc-41ff-9134-859f4cd8d05e admin admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:05:41.563072 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aace275-be76-4853-ae9d-e6fba62da9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:05:41.566055 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aace275-be76-4853-ae9d-e6fba62da9ad admin admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:05:41.566055 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aace275-be76-4853-ae9d-e6fba62da9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:05:41.566055 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aace275-be76-4853-ae9d-e6fba62da9ad admin admin] PATH_INFO: `/v3/users` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:05:41.566055 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aace275-be76-4853-ae9d-e6fba62da9ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:05:41.567102 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: WARNING py.warnings [None req-2aace275-be76-4853-ae9d-e6fba62da9ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 13:05:41.567102 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: warnings.warn(msg) Jul 14 13:05:41.567102 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: Jul 14 13:05:41.569026 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aace275-be76-4853-ae9d-e6fba62da9ad admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:05:41.658503 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 557/1115] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 13:05:41 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 13:05:41.662855 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab71a0-7a7a-49c4-82de-26f616ae23df admin admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:05:41.682629 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bab71a0-7a7a-49c4-82de-26f616ae23df admin admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:05:41.689230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d80b1-1a05-4815-be30-cd6a82253d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:05:41.689979 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d80b1-1a05-4815-be30-cd6a82253d52 admin admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:05:41.690260 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d80b1-1a05-4815-be30-cd6a82253d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:05:41.690551 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1d80b1-1a05-4815-be30-cd6a82253d52 admin admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:05:41.691449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d80b1-1a05-4815-be30-cd6a82253d52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:05:41.692480 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: WARNING py.warnings [None req-8c1d80b1-1a05-4815-be30-cd6a82253d52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 13:05:41.692480 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: warnings.warn(msg) Jul 14 13:05:41.692480 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: Jul 14 13:05:41.693404 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1d80b1-1a05-4815-be30-cd6a82253d52 admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:05:41.707739 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 559/1116] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 13:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 13:05:41.712590 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aace275-be76-4853-ae9d-e6fba62da9ad admin admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:05:41.723681 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aace275-be76-4853-ae9d-e6fba62da9ad admin admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:05:41.729270 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b03239-e99a-46f8-a76c-74af076a5124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:05:41.729880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b03239-e99a-46f8-a76c-74af076a5124 admin admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:05:41.730207 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b03239-e99a-46f8-a76c-74af076a5124 admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:05:41.730446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b03239-e99a-46f8-a76c-74af076a5124 admin admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:05:41.731174 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b03239-e99a-46f8-a76c-74af076a5124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:05:41.732199 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: WARNING py.warnings [None req-a1b03239-e99a-46f8-a76c-74af076a5124 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 13:05:41.732199 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: warnings.warn(msg) Jul 14 13:05:41.732199 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: Jul 14 13:05:41.733121 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b03239-e99a-46f8-a76c-74af076a5124 admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:05:41.746945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 558/1117] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 13:05:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 13:05:41.751396 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d80b1-1a05-4815-be30-cd6a82253d52 admin admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:05:41.761610 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1d80b1-1a05-4815-be30-cd6a82253d52 admin admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:05:41.766316 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840066f1-1b64-4d16-9907-47dc5e846a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:05:41.767206 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840066f1-1b64-4d16-9907-47dc5e846a18 admin admin] REQUEST_METHOD: `PUT` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:05:41.767496 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840066f1-1b64-4d16-9907-47dc5e846a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:05:41.767781 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840066f1-1b64-4d16-9907-47dc5e846a18 admin admin] PATH_INFO: `/v3/projects/60cac5f788fa4299977a5b6fe9b73050/users/fc841dbe09904cb7917b9d5e76f5499e/roles/669c23212b4843c8900c3d2e58fb6e0f` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:05:41.784143 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840066f1-1b64-4d16-9907-47dc5e846a18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60cac5f788fa4299977a5b6fe9b73050, user_id=fc841dbe09904cb7917b9d5e76f5499e, role_id=669c23212b4843c8900c3d2e58fb6e0f)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:05:41.785238 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: WARNING py.warnings [None req-840066f1-1b64-4d16-9907-47dc5e846a18 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 13:05:41.785238 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: warnings.warn(msg) Jul 14 13:05:41.785238 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: Jul 14 13:05:41.787268 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840066f1-1b64-4d16-9907-47dc5e846a18 admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:05:41.881203 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 560/1118] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 13:05:41 2022] PUT /identity/v3/projects/60cac5f788fa4299977a5b6fe9b73050/users/fc841dbe09904cb7917b9d5e76f5499e/roles/669c23212b4843c8900c3d2e58fb6e0f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 13:05:41.893669 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9fece-9768-45f9-a913-6daf5e61a06c None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:05:41.893993 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9fece-9768-45f9-a913-6daf5e61a06c None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:05:41.894221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c9fece-9768-45f9-a913-6daf5e61a06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:05:41.922551 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-22c9fece-9768-45f9-a913-6daf5e61a06c None None] MFA Rules not processed for user `fc841dbe09904cb7917b9d5e76f5499e`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:05:41.923952 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-22c9fece-9768-45f9-a913-6daf5e61a06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:05:41.990789 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 559/1119] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:05:41 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:05:42.004382 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99389451-4a17-40b2-baef-22a07320471c None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:05:42.004699 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99389451-4a17-40b2-baef-22a07320471c None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:05:42.004982 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99389451-4a17-40b2-baef-22a07320471c None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:05:42.006345 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 561/1120] 10.222.0.40 () {54 vars in 963 bytes} [Thu Jul 14 13:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:05:42.012685 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f202a-3fcd-4bce-b5bc-25285e134885 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:05:42.012984 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f202a-3fcd-4bce-b5bc-25285e134885 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:05:42.013266 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92f202a-3fcd-4bce-b5bc-25285e134885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:05:42.032961 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-e92f202a-3fcd-4bce-b5bc-25285e134885 None None] MFA Rules not processed for user `efbe88187dd84518818114165f60a5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:05:42.034188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-e92f202a-3fcd-4bce-b5bc-25285e134885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:05:42.106765 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:05:42.117842 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 560/1121] 10.222.0.40 () {58 vars in 1060 bytes} [Thu Jul 14 13:05:42 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:05:42.129426 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99389451-4a17-40b2-baef-22a07320471c None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:05:42.149208 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99389451-4a17-40b2-baef-22a07320471c None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:05:42.149208 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b1dd2-bb5f-4a6d-9a82-3e95575b9327 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbe88187dd84518818114165f60a5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:05:42.149208 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b1dd2-bb5f-4a6d-9a82-3e95575b9327 service cinder] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:05:42.149208 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b1dd2-bb5f-4a6d-9a82-3e95575b9327 service cinder] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:05:42.150493 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057b1dd2-bb5f-4a6d-9a82-3e95575b9327 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:05:42.159819 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b1dd2-bb5f-4a6d-9a82-3e95575b9327 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:05:42.161407 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057b1dd2-bb5f-4a6d-9a82-3e95575b9327 service cinder] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:05:42.171532 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 562/1122] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:05:42 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:05:42.217185 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174a8ec-aa4f-42bf-9564-476860e68a31 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:05:42.217478 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174a8ec-aa4f-42bf-9564-476860e68a31 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:05:42.217766 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174a8ec-aa4f-42bf-9564-476860e68a31 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:05:42.219046 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 561/1123] 10.222.0.40 () {52 vars in 829 bytes} [Thu Jul 14 13:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:05:42.223043 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b1dd2-bb5f-4a6d-9a82-3e95575b9327 service cinder] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:05:42.351122 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057b1dd2-bb5f-4a6d-9a82-3e95575b9327 service cinder] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:05:42.357364 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf787f8-0a31-4bcf-a17e-f769189bab70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:05:42.358247 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf787f8-0a31-4bcf-a17e-f769189bab70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:05:42.358738 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf787f8-0a31-4bcf-a17e-f769189bab70 admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:05:42.359189 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf787f8-0a31-4bcf-a17e-f769189bab70 admin admin] PATH_INFO: `/v3/users/fc841dbe09904cb7917b9d5e76f5499e` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:05:42.361017 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf787f8-0a31-4bcf-a17e-f769189bab70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc841dbe09904cb7917b9d5e76f5499e)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:05:42.362055 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: WARNING py.warnings [None req-8bf787f8-0a31-4bcf-a17e-f769189bab70 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 13:05:42.362055 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: warnings.warn(msg) Jul 14 13:05:42.362055 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: Jul 14 13:05:42.363283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf787f8-0a31-4bcf-a17e-f769189bab70 admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:05:42.592548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-8bf787f8-0a31-4bcf-a17e-f769189bab70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc841dbe09904cb7917b9d5e76f5499e'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:05:42.724673 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-8bf787f8-0a31-4bcf-a17e-f769189bab70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc841dbe09904cb7917b9d5e76f5499e'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:05:42.741490 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-8bf787f8-0a31-4bcf-a17e-f769189bab70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc841dbe09904cb7917b9d5e76f5499e'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:05:42.742730 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-8bf787f8-0a31-4bcf-a17e-f769189bab70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc841dbe09904cb7917b9d5e76f5499e'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:05:42.767995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:05:42.771622 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-8bf787f8-0a31-4bcf-a17e-f769189bab70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc841dbe09904cb7917b9d5e76f5499e'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:05:42.781690 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 563/1124] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 13:05:42 2022] DELETE /identity/v3/users/fc841dbe09904cb7917b9d5e76f5499e => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 13:05:42.786015 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd44b9-8fae-49f7-8912-fcb8c5e945f6 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:05:42.786521 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd44b9-8fae-49f7-8912-fcb8c5e945f6 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:05:42.786981 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bd44b9-8fae-49f7-8912-fcb8c5e945f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:05:42.808628 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-67bd44b9-8fae-49f7-8912-fcb8c5e945f6 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:05:42.809880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-67bd44b9-8fae-49f7-8912-fcb8c5e945f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:05:42.884108 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 562/1125] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:05:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 13:05:42.895775 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf787f8-0a31-4bcf-a17e-f769189bab70 admin admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:05:42.897380 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-8bf787f8-0a31-4bcf-a17e-f769189bab70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:05:42.954925 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf787f8-0a31-4bcf-a17e-f769189bab70 admin admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:05:42.958493 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7851b8a0-e137-455c-a6a3-55e1756a45ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:05:42.959129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851b8a0-e137-455c-a6a3-55e1756a45ef service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:05:42.959413 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851b8a0-e137-455c-a6a3-55e1756a45ef service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:05:42.959692 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7851b8a0-e137-455c-a6a3-55e1756a45ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:05:42.968685 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851b8a0-e137-455c-a6a3-55e1756a45ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:05:42.974145 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7851b8a0-e137-455c-a6a3-55e1756a45ef service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:05:42.984273 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 564/1126] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:05:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:05:43.526975 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd44b9-8fae-49f7-8912-fcb8c5e945f6 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:05:43.530061 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-67bd44b9-8fae-49f7-8912-fcb8c5e945f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:05:43.544733 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bd44b9-8fae-49f7-8912-fcb8c5e945f6 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:05:43.552388 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340e2dbb-d64f-46d5-9478-5a1020bd8e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:05:43.553325 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e2dbb-d64f-46d5-9478-5a1020bd8e9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:05:43.553616 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e2dbb-d64f-46d5-9478-5a1020bd8e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:05:43.553898 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340e2dbb-d64f-46d5-9478-5a1020bd8e9b admin admin] PATH_INFO: `/v3/projects/60cac5f788fa4299977a5b6fe9b73050` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:05:43.555532 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e2dbb-d64f-46d5-9478-5a1020bd8e9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=60cac5f788fa4299977a5b6fe9b73050)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:05:43.557147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: WARNING py.warnings [None req-340e2dbb-d64f-46d5-9478-5a1020bd8e9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 13:05:43.557147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: warnings.warn(msg) Jul 14 13:05:43.557147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: Jul 14 13:05:43.558364 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340e2dbb-d64f-46d5-9478-5a1020bd8e9b admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:05:43.679505 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-340e2dbb-d64f-46d5-9478-5a1020bd8e9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60cac5f788fa4299977a5b6fe9b73050', 'request_id': 'req-340e2dbb-d64f-46d5-9478-5a1020bd8e9b'} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:05:43.693101 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-340e2dbb-d64f-46d5-9478-5a1020bd8e9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60cac5f788fa4299977a5b6fe9b73050', 'request_id': 'req-340e2dbb-d64f-46d5-9478-5a1020bd8e9b'} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:05:43.766171 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-340e2dbb-d64f-46d5-9478-5a1020bd8e9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60cac5f788fa4299977a5b6fe9b73050', 'request_id': 'req-340e2dbb-d64f-46d5-9478-5a1020bd8e9b'} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:05:43.781716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-340e2dbb-d64f-46d5-9478-5a1020bd8e9b admin admin] The token cache is being invalidate because project 60cac5f788fa4299977a5b6fe9b73050 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 13:05:43.782000 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-340e2dbb-d64f-46d5-9478-5a1020bd8e9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:05:43.782739 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-340e2dbb-d64f-46d5-9478-5a1020bd8e9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:05:43.786556 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 563/1127] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 13:05:43 2022] DELETE /identity/v3/projects/60cac5f788fa4299977a5b6fe9b73050 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 13:05:52.979698 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:05:53.776776 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:07:07.269161 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cfb9c-a0ed-4e5c-affd-35d334414061 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:07.269757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cfb9c-a0ed-4e5c-affd-35d334414061 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:07.269757 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92cfb9c-a0ed-4e5c-affd-35d334414061 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:07.271103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 565/1128] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 13:07:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:07:07.276653 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a687c2-8e24-4e5b-b4b1-d3c96bbbcbaa None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:07.277128 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a687c2-8e24-4e5b-b4b1-d3c96bbbcbaa None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:07.277236 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a687c2-8e24-4e5b-b4b1-d3c96bbbcbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:07.295457 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-a9a687c2-8e24-4e5b-b4b1-d3c96bbbcbaa None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:07:07.296676 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-a9a687c2-8e24-4e5b-b4b1-d3c96bbbcbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:07:07.354899 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 564/1129] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 13:07:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:07:07.513144 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cfb9c-a0ed-4e5c-affd-35d334414061 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:07:07.514962 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-d92cfb9c-a0ed-4e5c-affd-35d334414061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:07:07.586958 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92cfb9c-a0ed-4e5c-affd-35d334414061 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:07:07.592358 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb79602-e2a1-4b79-a9ec-fba413f93ff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:07:07.593028 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb79602-e2a1-4b79-a9ec-fba413f93ff2 service nova] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:07.593311 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb79602-e2a1-4b79-a9ec-fba413f93ff2 service nova] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:07.593586 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb79602-e2a1-4b79-a9ec-fba413f93ff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:07.602215 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb79602-e2a1-4b79-a9ec-fba413f93ff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:07:07.603796 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb79602-e2a1-4b79-a9ec-fba413f93ff2 service nova] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:07:07.613058 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 566/1130] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:07:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:07:08.450638 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03286c9-cd7c-4e7e-a015-6f7e52e77bab None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:08.451173 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03286c9-cd7c-4e7e-a015-6f7e52e77bab None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:08.451173 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03286c9-cd7c-4e7e-a015-6f7e52e77bab None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:08.452453 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 565/1131] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 13:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:07:08.457243 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe6409-6ff8-4278-b6a2-b24424f26c3c None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:08.457653 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe6409-6ff8-4278-b6a2-b24424f26c3c None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:08.457814 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe6409-6ff8-4278-b6a2-b24424f26c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:08.477064 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-6cfe6409-6ff8-4278-b6a2-b24424f26c3c None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:07:08.478279 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-6cfe6409-6ff8-4278-b6a2-b24424f26c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:07:08.486265 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 567/1132] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 13:07:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:07:08.642262 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03286c9-cd7c-4e7e-a015-6f7e52e77bab None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:07:08.656176 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03286c9-cd7c-4e7e-a015-6f7e52e77bab None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:07:08.661188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be549a3a-7ba8-4402-a82f-28eaafd71d24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:07:08.661819 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be549a3a-7ba8-4402-a82f-28eaafd71d24 service nova] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:08.662105 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be549a3a-7ba8-4402-a82f-28eaafd71d24 service nova] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:08.662406 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be549a3a-7ba8-4402-a82f-28eaafd71d24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:08.671531 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be549a3a-7ba8-4402-a82f-28eaafd71d24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:07:08.673162 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be549a3a-7ba8-4402-a82f-28eaafd71d24 service nova] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:07:08.682781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 566/1133] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:07:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:07:13.210213 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9e1b8-6e03-45c0-a40a-8dbdc2b0309b None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:13.210766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9e1b8-6e03-45c0-a40a-8dbdc2b0309b None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:13.210766 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9e1b8-6e03-45c0-a40a-8dbdc2b0309b None None] PATH_INFO: `/v3` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:13.212069 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 568/1134] 10.222.0.59 () {54 vars in 925 bytes} [Thu Jul 14 13:07:13 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 13:07:13.218043 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb806360-064d-43bb-8017-dd7679b05d7d None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:13.218477 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb806360-064d-43bb-8017-dd7679b05d7d None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:13.218612 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb806360-064d-43bb-8017-dd7679b05d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:13.236731 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-cb806360-064d-43bb-8017-dd7679b05d7d None None] MFA Rules not processed for user `ee845fa8cb614ce183d4608e63c3e2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:07:13.237935 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-cb806360-064d-43bb-8017-dd7679b05d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:07:13.318547 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 567/1135] 10.222.0.59 () {58 vars in 1015 bytes} [Thu Jul 14 13:07:13 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:07:17.552466 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28935df4-27ef-4f31-9c75-639da2ebb03d None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:17.553261 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28935df4-27ef-4f31-9c75-639da2ebb03d None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:17.553261 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28935df4-27ef-4f31-9c75-639da2ebb03d None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:17.554525 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 569/1136] 10.222.0.40 () {54 vars in 960 bytes} [Thu Jul 14 13:07:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:07:17.559801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159b4be-66f7-4846-8f7d-2be399a50701 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:17.560227 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159b4be-66f7-4846-8f7d-2be399a50701 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:17.560370 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e159b4be-66f7-4846-8f7d-2be399a50701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:17.579259 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-e159b4be-66f7-4846-8f7d-2be399a50701 None None] MFA Rules not processed for user `ee845fa8cb614ce183d4608e63c3e2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:07:17.580446 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-e159b4be-66f7-4846-8f7d-2be399a50701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:07:17.589444 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 568/1137] 10.222.0.40 () {58 vars in 1057 bytes} [Thu Jul 14 13:07:17 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:07:17.597029 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28935df4-27ef-4f31-9c75-639da2ebb03d None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:07:17.611001 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28935df4-27ef-4f31-9c75-639da2ebb03d None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:07:17.616402 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50f5276-867b-47c2-b277-92862dfc92bf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee845fa8cb614ce183d4608e63c3e2d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:07:17.617065 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f5276-867b-47c2-b277-92862dfc92bf service placement] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:17.617355 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f5276-867b-47c2-b277-92862dfc92bf service placement] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:17.617633 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50f5276-867b-47c2-b277-92862dfc92bf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:17.626169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f5276-867b-47c2-b277-92862dfc92bf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:07:17.627784 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50f5276-867b-47c2-b277-92862dfc92bf service placement] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:07:17.638236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 570/1138] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:07:17 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:07:19.896213 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc0614-151e-479e-a580-d780a6819052 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:19.896830 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc0614-151e-479e-a580-d780a6819052 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:19.896830 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cc0614-151e-479e-a580-d780a6819052 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:19.898268 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 569/1139] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 13:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:07:19.903469 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917d994-3c52-455e-a913-496f4b5773fa None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:19.903915 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917d994-3c52-455e-a913-496f4b5773fa None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:19.904128 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917d994-3c52-455e-a913-496f4b5773fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:19.924468 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-3917d994-3c52-455e-a913-496f4b5773fa None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:07:19.925723 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-3917d994-3c52-455e-a913-496f4b5773fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:07:19.934449 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 571/1140] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 13:07:19 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:07:20.093177 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc0614-151e-479e-a580-d780a6819052 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:07:20.107979 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cc0614-151e-479e-a580-d780a6819052 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:07:20.113028 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec79012f-b37b-4b20-a580-2cfe860b19d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:07:20.113667 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79012f-b37b-4b20-a580-2cfe860b19d9 service nova] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:20.113957 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79012f-b37b-4b20-a580-2cfe860b19d9 service nova] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:20.114232 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec79012f-b37b-4b20-a580-2cfe860b19d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:20.123059 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79012f-b37b-4b20-a580-2cfe860b19d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:07:20.124717 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec79012f-b37b-4b20-a580-2cfe860b19d9 service nova] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:07:20.135304 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 570/1141] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:07:20 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:07:20.974840 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b51192-0804-4405-9b23-cfa66b776023 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:20.975384 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b51192-0804-4405-9b23-cfa66b776023 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:20.975384 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b51192-0804-4405-9b23-cfa66b776023 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:20.976713 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 572/1142] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jul 14 13:07:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:07:20.981536 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7783b-4300-464b-aeb7-d04d056db86c None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:20.981945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7783b-4300-464b-aeb7-d04d056db86c None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:20.982097 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7783b-4300-464b-aeb7-d04d056db86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:20.999479 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-5df7783b-4300-464b-aeb7-d04d056db86c None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:07:21.000665 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-5df7783b-4300-464b-aeb7-d04d056db86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:07:21.008339 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 571/1143] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jul 14 13:07:20 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:07:21.167004 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b51192-0804-4405-9b23-cfa66b776023 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:07:21.180489 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b51192-0804-4405-9b23-cfa66b776023 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:07:21.185477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c229503-4f4e-4da3-b39c-ca9d6fd0c5c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:07:21.186116 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c229503-4f4e-4da3-b39c-ca9d6fd0c5c1 service nova] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:21.186407 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c229503-4f4e-4da3-b39c-ca9d6fd0c5c1 service nova] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:21.186678 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c229503-4f4e-4da3-b39c-ca9d6fd0c5c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:21.195778 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c229503-4f4e-4da3-b39c-ca9d6fd0c5c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:07:21.197436 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c229503-4f4e-4da3-b39c-ca9d6fd0c5c1 service nova] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:07:21.206738 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 573/1144] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:07:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:07:25.364251 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de0193-ca4b-493b-a201-2feebeaaf65d None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:25.364893 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de0193-ca4b-493b-a201-2feebeaaf65d None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:25.364893 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7de0193-ca4b-493b-a201-2feebeaaf65d None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:25.366244 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 572/1145] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 13:07:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:07:25.371720 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437142c-8dc0-46a0-8425-03be17c62cd7 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:25.379623 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437142c-8dc0-46a0-8425-03be17c62cd7 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:25.379623 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3437142c-8dc0-46a0-8425-03be17c62cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:25.390148 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-3437142c-8dc0-46a0-8425-03be17c62cd7 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:07:25.391294 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-3437142c-8dc0-46a0-8425-03be17c62cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:07:25.399637 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 574/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 13:07:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:07:25.437698 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de0193-ca4b-493b-a201-2feebeaaf65d None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:07:25.439357 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-b7de0193-ca4b-493b-a201-2feebeaaf65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:07:25.505203 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7de0193-ca4b-493b-a201-2feebeaaf65d None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:07:25.508736 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc25f9f-d73c-4792-a96a-a16f08dd513f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:07:25.509388 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc25f9f-d73c-4792-a96a-a16f08dd513f service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:25.509673 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc25f9f-d73c-4792-a96a-a16f08dd513f service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:25.509953 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc25f9f-d73c-4792-a96a-a16f08dd513f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:25.519482 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc25f9f-d73c-4792-a96a-a16f08dd513f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:07:25.521046 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc25f9f-d73c-4792-a96a-a16f08dd513f service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:07:25.525954 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=100 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:07:25.531068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 573/1147] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:07:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:07:27.764417 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab90a6-97eb-4a02-bd96-6975dd857b87 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:27.765020 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab90a6-97eb-4a02-bd96-6975dd857b87 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:27.765020 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab90a6-97eb-4a02-bd96-6975dd857b87 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:27.766414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 575/1148] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 13:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:07:27.771574 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e935e7-d593-47b7-90b6-a1eb1d78d707 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:27.771984 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e935e7-d593-47b7-90b6-a1eb1d78d707 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:27.772138 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e935e7-d593-47b7-90b6-a1eb1d78d707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:27.790879 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-09e935e7-d593-47b7-90b6-a1eb1d78d707 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:07:27.792098 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-09e935e7-d593-47b7-90b6-a1eb1d78d707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:07:27.801077 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 574/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 13:07:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:07:27.838627 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab90a6-97eb-4a02-bd96-6975dd857b87 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:07:27.840347 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-98ab90a6-97eb-4a02-bd96-6975dd857b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:07:27.853859 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab90a6-97eb-4a02-bd96-6975dd857b87 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:07:27.857401 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7f885-1462-4ec8-980c-269bcb1c405d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:07:27.858033 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7f885-1462-4ec8-980c-269bcb1c405d service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:27.858315 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7f885-1462-4ec8-980c-269bcb1c405d service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:27.858591 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7f885-1462-4ec8-980c-269bcb1c405d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:27.868287 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7f885-1462-4ec8-980c-269bcb1c405d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:07:27.869749 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7f885-1462-4ec8-980c-269bcb1c405d service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:07:27.879168 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 576/1150] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:07:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:07:31.688018 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b40c67-78f6-4033-bd55-1c4a9b42f8d8 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:31.688561 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b40c67-78f6-4033-bd55-1c4a9b42f8d8 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:31.688709 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b40c67-78f6-4033-bd55-1c4a9b42f8d8 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:31.690183 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 575/1151] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 13:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:07:31.695589 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4ac01-2f76-4381-9b12-8ecc8aabeae3 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:31.708995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4ac01-2f76-4381-9b12-8ecc8aabeae3 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:31.708995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e4ac01-2f76-4381-9b12-8ecc8aabeae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:31.714306 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-a5e4ac01-2f76-4381-9b12-8ecc8aabeae3 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:07:31.715535 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-a5e4ac01-2f76-4381-9b12-8ecc8aabeae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:07:31.723984 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 577/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 13:07:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:07:31.994949 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b40c67-78f6-4033-bd55-1c4a9b42f8d8 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:07:31.996677 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-95b40c67-78f6-4033-bd55-1c4a9b42f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:07:32.055179 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b40c67-78f6-4033-bd55-1c4a9b42f8d8 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:07:32.058747 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d3b145-844b-41a6-9b20-152a1f145ff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbe88187dd84518818114165f60a5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:07:32.059380 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3b145-844b-41a6-9b20-152a1f145ff9 service cinder] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:32.059667 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3b145-844b-41a6-9b20-152a1f145ff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:32.059945 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d3b145-844b-41a6-9b20-152a1f145ff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:32.069371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3b145-844b-41a6-9b20-152a1f145ff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:07:32.070806 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d3b145-844b-41a6-9b20-152a1f145ff9 service cinder] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:07:32.080763 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 576/1153] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:07:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:07:34.353644 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09348c-0daa-4129-b165-f7fe172e21ce None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:34.354216 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09348c-0daa-4129-b165-f7fe172e21ce None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:34.354216 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d09348c-0daa-4129-b165-f7fe172e21ce None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:34.355587 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 578/1154] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jul 14 13:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:07:34.360820 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f15fb-79f5-4a22-83d8-6ebf6cb29dc5 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:34.361283 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f15fb-79f5-4a22-83d8-6ebf6cb29dc5 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:34.361391 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f15fb-79f5-4a22-83d8-6ebf6cb29dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:34.378795 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-2b6f15fb-79f5-4a22-83d8-6ebf6cb29dc5 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:07:34.379999 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-2b6f15fb-79f5-4a22-83d8-6ebf6cb29dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:07:34.387700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 577/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jul 14 13:07:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:07:34.659553 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09348c-0daa-4129-b165-f7fe172e21ce None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:07:34.661251 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-8d09348c-0daa-4129-b165-f7fe172e21ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:07:34.668900 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=63 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:07:34.674656 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d09348c-0daa-4129-b165-f7fe172e21ce None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:07:34.678141 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ecf9e-12f4-482a-9ba6-d6f95f22321d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbe88187dd84518818114165f60a5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:07:34.678784 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ecf9e-12f4-482a-9ba6-d6f95f22321d service cinder] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:07:34.679069 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ecf9e-12f4-482a-9ba6-d6f95f22321d service cinder] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:07:34.679348 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ecf9e-12f4-482a-9ba6-d6f95f22321d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:07:34.688789 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ecf9e-12f4-482a-9ba6-d6f95f22321d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:07:34.690417 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ecf9e-12f4-482a-9ba6-d6f95f22321d service cinder] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:07:34.699792 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 579/1156] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:07:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:07:44.373720 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=32 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:07:44.729705 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=5 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:08:54.944509 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dc3df-cefa-4562-b84a-83728d2750f5 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:54.945149 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dc3df-cefa-4562-b84a-83728d2750f5 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:54.945149 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0dc3df-cefa-4562-b84a-83728d2750f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:54.964234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-bb0dc3df-cefa-4562-b84a-83728d2750f5 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:08:54.964656 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bea9e2-77d6-4f5d-93ea-0885266681e2 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:54.965164 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bea9e2-77d6-4f5d-93ea-0885266681e2 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:54.965266 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bea9e2-77d6-4f5d-93ea-0885266681e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:54.965487 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-bb0dc3df-cefa-4562-b84a-83728d2750f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:08:54.973409 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 578/1157] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:08:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:08:54.981944 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd16bf-4ad7-4cb0-b0fd-d09bb62831a8 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:54.982239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd16bf-4ad7-4cb0-b0fd-d09bb62831a8 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:54.982521 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd16bf-4ad7-4cb0-b0fd-d09bb62831a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:54.982964 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-27bea9e2-77d6-4f5d-93ea-0885266681e2 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:08:54.984160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-27bea9e2-77d6-4f5d-93ea-0885266681e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:08:54.992939 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 580/1158] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:08:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 13:08:55.000722 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-c1dd16bf-4ad7-4cb0-b0fd-d09bb62831a8 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:08:55.002967 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2805251-c313-415a-b8a2-ce9c05f19bdb None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:55.002967 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2805251-c313-415a-b8a2-ce9c05f19bdb None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:55.002967 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2805251-c313-415a-b8a2-ce9c05f19bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:55.003225 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-c1dd16bf-4ad7-4cb0-b0fd-d09bb62831a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:08:55.010431 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 579/1159] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:08:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 13:08:55.015041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd16bf-4ad7-4cb0-b0fd-d09bb62831a8 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:08:55.021010 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-e2805251-c313-415a-b8a2-ce9c05f19bdb None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:08:55.022205 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-e2805251-c313-415a-b8a2-ce9c05f19bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:08:55.024984 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd16bf-4ad7-4cb0-b0fd-d09bb62831a8 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:08:55.029700 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581d706-1fdb-4b40-b739-1b22566bafdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:08:55.030189 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 581/1160] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:08:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 13:08:55.030355 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581d706-1fdb-4b40-b739-1b22566bafdd admin admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:55.030630 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581d706-1fdb-4b40-b739-1b22566bafdd admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:55.030904 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4581d706-1fdb-4b40-b739-1b22566bafdd admin admin] PATH_INFO: `/v3/domains` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:55.031626 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581d706-1fdb-4b40-b739-1b22566bafdd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87244) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 13:08:55.031938 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581d706-1fdb-4b40-b739-1b22566bafdd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:08:55.033732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4581d706-1fdb-4b40-b739-1b22566bafdd admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:08:55.034712 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2805251-c313-415a-b8a2-ce9c05f19bdb None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:08:55.043764 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2805251-c313-415a-b8a2-ce9c05f19bdb None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:08:55.049032 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 580/1161] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 13:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 14 13:08:55.049160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b501d1-09fb-4edf-b801-38dd119401a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:08:55.049160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b501d1-09fb-4edf-b801-38dd119401a6 admin admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:55.049424 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b501d1-09fb-4edf-b801-38dd119401a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:55.049615 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b501d1-09fb-4edf-b801-38dd119401a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:55.050332 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b501d1-09fb-4edf-b801-38dd119401a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87245) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 14 13:08:55.050656 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b501d1-09fb-4edf-b801-38dd119401a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:08:55.051667 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: WARNING py.warnings [None req-83b501d1-09fb-4edf-b801-38dd119401a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 13:08:55.051667 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: warnings.warn(msg) Jul 14 13:08:55.051667 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: Jul 14 13:08:55.052545 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b501d1-09fb-4edf-b801-38dd119401a6 admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:08:55.056541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581d706-1fdb-4b40-b739-1b22566bafdd admin admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:08:55.066142 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 582/1162] 10.222.0.40 () {58 vars in 1152 bytes} [Thu Jul 14 13:08:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 14 13:08:55.066827 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4581d706-1fdb-4b40-b739-1b22566bafdd admin admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:08:55.071806 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9411f8-6978-4df0-8c6d-89528e523a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:08:55.072450 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9411f8-6978-4df0-8c6d-89528e523a44 admin admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:55.072781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9411f8-6978-4df0-8c6d-89528e523a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:55.073063 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9411f8-6978-4df0-8c6d-89528e523a44 admin admin] PATH_INFO: `/v3/projects` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:55.073751 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9411f8-6978-4df0-8c6d-89528e523a44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:08:55.074281 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b501d1-09fb-4edf-b801-38dd119401a6 admin admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:08:55.074763 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: WARNING py.warnings [None req-8a9411f8-6978-4df0-8c6d-89528e523a44 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 13:08:55.074763 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: warnings.warn(msg) Jul 14 13:08:55.074763 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: Jul 14 13:08:55.075956 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9411f8-6978-4df0-8c6d-89528e523a44 admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:08:55.085163 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b501d1-09fb-4edf-b801-38dd119401a6 admin admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:08:55.090175 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc51863-089d-4321-9c94-b3fc95f5201a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:08:55.090822 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc51863-089d-4321-9c94-b3fc95f5201a admin admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:55.091108 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc51863-089d-4321-9c94-b3fc95f5201a admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:55.091385 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc51863-089d-4321-9c94-b3fc95f5201a admin admin] PATH_INFO: `/v3/projects` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:55.092077 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc51863-089d-4321-9c94-b3fc95f5201a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:08:55.094142 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc51863-089d-4321-9c94-b3fc95f5201a admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:08:55.254702 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 581/1163] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 13:08:55 2022] POST /identity/v3/projects => generated 383 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 13:08:55.264305 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9411f8-6978-4df0-8c6d-89528e523a44 admin admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:08:55.270371 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 583/1164] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 13:08:55 2022] POST /identity/v3/projects => generated 379 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 13:08:55.271740 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc51863-089d-4321-9c94-b3fc95f5201a admin admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:08:55.332442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9411f8-6978-4df0-8c6d-89528e523a44 admin admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:08:55.337664 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab09523-06a7-45b9-8a00-7900df3bfc1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:08:55.338356 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab09523-06a7-45b9-8a00-7900df3bfc1e admin admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:55.338630 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab09523-06a7-45b9-8a00-7900df3bfc1e admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:55.338912 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab09523-06a7-45b9-8a00-7900df3bfc1e admin admin] PATH_INFO: `/v3/users` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:55.339344 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc51863-089d-4321-9c94-b3fc95f5201a admin admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:08:55.339625 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab09523-06a7-45b9-8a00-7900df3bfc1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:08:55.341680 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab09523-06a7-45b9-8a00-7900df3bfc1e admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:08:55.345656 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b591b9-868f-4a74-b7d9-779e2ea68e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:08:55.353323 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b591b9-868f-4a74-b7d9-779e2ea68e7a admin admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:55.353323 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b591b9-868f-4a74-b7d9-779e2ea68e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:55.353323 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b591b9-868f-4a74-b7d9-779e2ea68e7a admin admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:55.353323 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b591b9-868f-4a74-b7d9-779e2ea68e7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:08:55.353323 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: WARNING py.warnings [None req-c4b591b9-868f-4a74-b7d9-779e2ea68e7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 13:08:55.353323 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: warnings.warn(msg) Jul 14 13:08:55.353323 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: Jul 14 13:08:55.353980 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b591b9-868f-4a74-b7d9-779e2ea68e7a admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:08:55.457325 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 584/1166] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 13:08:55 2022] POST /identity/v3/users => generated 290 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 13:08:55.457559 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 582/1166] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 13:08:55 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 13:08:55.461517 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b591b9-868f-4a74-b7d9-779e2ea68e7a admin admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:08:55.461838 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab09523-06a7-45b9-8a00-7900df3bfc1e admin admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:08:55.472490 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab09523-06a7-45b9-8a00-7900df3bfc1e admin admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:08:55.472897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b591b9-868f-4a74-b7d9-779e2ea68e7a admin admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:08:55.477250 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cb25f-809e-402a-a414-6a26e35c80f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:08:55.477811 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f0abb-9644-44aa-a8ea-c4b65911077d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:08:55.477962 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cb25f-809e-402a-a414-6a26e35c80f4 admin admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:55.478220 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cb25f-809e-402a-a414-6a26e35c80f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:55.478471 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f0abb-9644-44aa-a8ea-c4b65911077d admin admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:55.478595 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17cb25f-809e-402a-a414-6a26e35c80f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:55.478765 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f0abb-9644-44aa-a8ea-c4b65911077d admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:55.479067 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3f0abb-9644-44aa-a8ea-c4b65911077d admin admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:55.479261 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cb25f-809e-402a-a414-6a26e35c80f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:08:55.479836 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f0abb-9644-44aa-a8ea-c4b65911077d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:08:55.480897 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17cb25f-809e-402a-a414-6a26e35c80f4 admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:08:55.481486 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3f0abb-9644-44aa-a8ea-c4b65911077d admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:08:55.492347 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 585/1167] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 13:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 13:08:55.492844 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 583/1168] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 13:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 13:08:55.496297 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f0abb-9644-44aa-a8ea-c4b65911077d admin admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:08:55.496625 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cb25f-809e-402a-a414-6a26e35c80f4 admin admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:08:55.507009 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17cb25f-809e-402a-a414-6a26e35c80f4 admin admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:08:55.507189 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3f0abb-9644-44aa-a8ea-c4b65911077d admin admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:08:55.511799 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3c440-a9ea-4481-b38d-be87dc4a1a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:08:55.512091 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9a218-452c-4b17-ac59-18e44f0f0153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:08:55.512458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3c440-a9ea-4481-b38d-be87dc4a1a4c admin admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:55.512788 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3c440-a9ea-4481-b38d-be87dc4a1a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:55.512909 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9a218-452c-4b17-ac59-18e44f0f0153 admin admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:55.513070 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f3c440-a9ea-4481-b38d-be87dc4a1a4c admin admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:55.513173 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9a218-452c-4b17-ac59-18e44f0f0153 admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:55.513343 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9a218-452c-4b17-ac59-18e44f0f0153 admin admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:55.513786 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3c440-a9ea-4481-b38d-be87dc4a1a4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:08:55.514061 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9a218-452c-4b17-ac59-18e44f0f0153 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:08:55.515386 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f3c440-a9ea-4481-b38d-be87dc4a1a4c admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:08:55.515655 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9a218-452c-4b17-ac59-18e44f0f0153 admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:08:55.526848 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 584/1170] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 13:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 13:08:55.527035 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 586/1170] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 13:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 13:08:55.530616 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3c440-a9ea-4481-b38d-be87dc4a1a4c admin admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:08:55.530738 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9a218-452c-4b17-ac59-18e44f0f0153 admin admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:08:55.541391 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9a218-452c-4b17-ac59-18e44f0f0153 admin admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:08:55.548339 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f3c440-a9ea-4481-b38d-be87dc4a1a4c admin admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:08:55.548339 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bfb1d-9dcc-414e-ad73-e33d0f2a7827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:08:55.549520 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939d53f-4bd2-4c9b-8b03-1e18ac9e2ffa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:08:55.549690 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bfb1d-9dcc-414e-ad73-e33d0f2a7827 admin admin] REQUEST_METHOD: `PUT` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:55.549690 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bfb1d-9dcc-414e-ad73-e33d0f2a7827 admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:55.549971 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939d53f-4bd2-4c9b-8b03-1e18ac9e2ffa admin admin] REQUEST_METHOD: `PUT` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:55.550106 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bfb1d-9dcc-414e-ad73-e33d0f2a7827 admin admin] PATH_INFO: `/v3/projects/3b92f91d118b45a18a0dfff141a85546/users/05d6241eb3e14a13b4e528c06ab5480e/roles/669c23212b4843c8900c3d2e58fb6e0f` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:55.550266 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939d53f-4bd2-4c9b-8b03-1e18ac9e2ffa admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:55.550266 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939d53f-4bd2-4c9b-8b03-1e18ac9e2ffa admin admin] PATH_INFO: `/v3/projects/cbe1bb4b402b49a3993f110cdc46384c/users/ce0eeaa4b4b54c6da48a86ebec8a1153/roles/669c23212b4843c8900c3d2e58fb6e0f` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:55.564567 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bfb1d-9dcc-414e-ad73-e33d0f2a7827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b92f91d118b45a18a0dfff141a85546, user_id=05d6241eb3e14a13b4e528c06ab5480e, role_id=669c23212b4843c8900c3d2e58fb6e0f)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:08:55.565113 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939d53f-4bd2-4c9b-8b03-1e18ac9e2ffa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbe1bb4b402b49a3993f110cdc46384c, user_id=ce0eeaa4b4b54c6da48a86ebec8a1153, role_id=669c23212b4843c8900c3d2e58fb6e0f)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:08:55.565645 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: WARNING py.warnings [None req-a41bfb1d-9dcc-414e-ad73-e33d0f2a7827 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 14 13:08:55.565645 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: warnings.warn(msg) Jul 14 13:08:55.565645 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: Jul 14 13:08:55.567644 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bfb1d-9dcc-414e-ad73-e33d0f2a7827 admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:08:55.569259 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939d53f-4bd2-4c9b-8b03-1e18ac9e2ffa admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:08:55.679708 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 585/1171] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 13:08:55 2022] PUT /identity/v3/projects/3b92f91d118b45a18a0dfff141a85546/users/05d6241eb3e14a13b4e528c06ab5480e/roles/669c23212b4843c8900c3d2e58fb6e0f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 13:08:55.684707 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7ea00-dc0a-4ca0-a7ac-1a3a588dc014 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:55.684997 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7ea00-dc0a-4ca0-a7ac-1a3a588dc014 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:55.685284 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7ea00-dc0a-4ca0-a7ac-1a3a588dc014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:55.699155 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 587/1172] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 13:08:55 2022] PUT /identity/v3/projects/cbe1bb4b402b49a3993f110cdc46384c/users/ce0eeaa4b4b54c6da48a86ebec8a1153/roles/669c23212b4843c8900c3d2e58fb6e0f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 13:08:55.705581 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-adf7ea00-dc0a-4ca0-a7ac-1a3a588dc014 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:08:55.706279 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ccc5d-bb23-4888-a546-b07054e2f121 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:55.706631 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ccc5d-bb23-4888-a546-b07054e2f121 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:55.706793 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-adf7ea00-dc0a-4ca0-a7ac-1a3a588dc014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:08:55.707025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ccc5d-bb23-4888-a546-b07054e2f121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:55.723935 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-929ccc5d-bb23-4888-a546-b07054e2f121 None None] MFA Rules not processed for user `ab5d7b1a37b74ac9a2830100d8a3e73f`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:08:55.725184 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-929ccc5d-bb23-4888-a546-b07054e2f121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:08:55.763562 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:08:55.779794 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:08:55.780334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 586/1173] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:08:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 13:08:55.790649 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7ea00-dc0a-4ca0-a7ac-1a3a588dc014 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:08:55.791867 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 588/1174] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:08:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 13:08:55.800818 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ccc5d-bb23-4888-a546-b07054e2f121 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:08:55.845484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7ea00-dc0a-4ca0-a7ac-1a3a588dc014 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:08:55.849196 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b635d0-d5f0-4e93-af43-689990ea46ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:08:55.849847 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b635d0-d5f0-4e93-af43-689990ea46ec service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:55.850135 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b635d0-d5f0-4e93-af43-689990ea46ec service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:55.850414 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b635d0-d5f0-4e93-af43-689990ea46ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:55.856255 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929ccc5d-bb23-4888-a546-b07054e2f121 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:08:55.860677 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b635d0-d5f0-4e93-af43-689990ea46ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:08:55.860906 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea357b39-d30a-4ec2-b081-35a444941eb2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:08:55.860906 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea357b39-d30a-4ec2-b081-35a444941eb2 service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:08:55.860906 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea357b39-d30a-4ec2-b081-35a444941eb2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:08:55.861194 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea357b39-d30a-4ec2-b081-35a444941eb2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:08:55.861289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b635d0-d5f0-4e93-af43-689990ea46ec service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:08:55.870230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea357b39-d30a-4ec2-b081-35a444941eb2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:08:55.870762 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 587/1175] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:08:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 13:08:55.871675 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea357b39-d30a-4ec2-b081-35a444941eb2 service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:08:55.883029 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 589/1176] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:08:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 13:09:03.667792 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ef073-1c6f-472f-83ea-36a6d0c48913 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:03.668386 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ef073-1c6f-472f-83ea-36a6d0c48913 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:03.669405 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ef073-1c6f-472f-83ea-36a6d0c48913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:03.721901 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-105ef073-1c6f-472f-83ea-36a6d0c48913 None None] MFA Rules not processed for user `05d6241eb3e14a13b4e528c06ab5480e`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:09:03.724556 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-105ef073-1c6f-472f-83ea-36a6d0c48913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:09:03.818916 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadcff8-8258-4f3a-a0bb-c04bfc278edf None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:03.819465 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadcff8-8258-4f3a-a0bb-c04bfc278edf None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:03.819465 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfadcff8-8258-4f3a-a0bb-c04bfc278edf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:03.854891 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 588/1177] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:09:03 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:09:03.860414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-dfadcff8-8258-4f3a-a0bb-c04bfc278edf None None] MFA Rules not processed for user `ce0eeaa4b4b54c6da48a86ebec8a1153`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:09:03.861340 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ef073-1c6f-472f-83ea-36a6d0c48913 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:03.861468 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-dfadcff8-8258-4f3a-a0bb-c04bfc278edf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:09:03.879205 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ef073-1c6f-472f-83ea-36a6d0c48913 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:03.885343 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73369a0-4c7a-4002-ada3-89cbcc352e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:03.886017 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73369a0-4c7a-4002-ada3-89cbcc352e35 admin admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:03.891079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73369a0-4c7a-4002-ada3-89cbcc352e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:03.891079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73369a0-4c7a-4002-ada3-89cbcc352e35 admin admin] PATH_INFO: `/v3/projects` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:03.891079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73369a0-4c7a-4002-ada3-89cbcc352e35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:03.893704 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73369a0-4c7a-4002-ada3-89cbcc352e35 admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:03.957579 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 590/1178] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:09:03 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 13:09:03.958825 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadcff8-8258-4f3a-a0bb-c04bfc278edf None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:03.971500 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfadcff8-8258-4f3a-a0bb-c04bfc278edf None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:03.978007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b41a43-758b-4268-b088-b70b245cb530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:03.978833 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b41a43-758b-4268-b088-b70b245cb530 admin admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:03.979217 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b41a43-758b-4268-b088-b70b245cb530 admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:03.979930 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b41a43-758b-4268-b088-b70b245cb530 admin admin] PATH_INFO: `/v3/projects` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:03.980345 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b41a43-758b-4268-b088-b70b245cb530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:03.982465 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b41a43-758b-4268-b088-b70b245cb530 admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:04.025506 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 589/1179] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 13:09:03 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 13:09:04.029743 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73369a0-4c7a-4002-ada3-89cbcc352e35 admin admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:04.105773 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73369a0-4c7a-4002-ada3-89cbcc352e35 admin admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:04.112994 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0335770-cda7-4aee-b8e5-798782629d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:04.113779 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0335770-cda7-4aee-b8e5-798782629d18 admin admin] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:04.114059 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0335770-cda7-4aee-b8e5-798782629d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:04.114336 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0335770-cda7-4aee-b8e5-798782629d18 admin admin] PATH_INFO: `/v3/users` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:04.115036 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0335770-cda7-4aee-b8e5-798782629d18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:04.117068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0335770-cda7-4aee-b8e5-798782629d18 admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:04.128460 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:09:04.144733 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 591/1180] 10.222.0.40 () {60 vars in 1152 bytes} [Thu Jul 14 13:09:03 2022] POST /identity/v3/projects => generated 385 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 14 13:09:04.147856 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b41a43-758b-4268-b088-b70b245cb530 admin admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:04.232737 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 590/1181] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 13:09:04 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 13:09:04.232884 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b41a43-758b-4268-b088-b70b245cb530 admin admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:04.233073 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0335770-cda7-4aee-b8e5-798782629d18 admin admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:04.251649 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaae1f0-6d1c-4022-8ec7-fc58ffd58dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:04.254239 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaae1f0-6d1c-4022-8ec7-fc58ffd58dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:04.254239 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaae1f0-6d1c-4022-8ec7-fc58ffd58dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:04.254402 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaae1f0-6d1c-4022-8ec7-fc58ffd58dd4 admin admin] PATH_INFO: `/v3/users` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:04.255025 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaae1f0-6d1c-4022-8ec7-fc58ffd58dd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:04.262256 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0335770-cda7-4aee-b8e5-798782629d18 admin admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:04.263931 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaae1f0-6d1c-4022-8ec7-fc58ffd58dd4 admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:04.274211 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be9119-edc4-41c4-a774-67ad12a04b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:04.275687 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be9119-edc4-41c4-a774-67ad12a04b33 admin admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:04.275971 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be9119-edc4-41c4-a774-67ad12a04b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:04.276248 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79be9119-edc4-41c4-a774-67ad12a04b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:04.277062 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be9119-edc4-41c4-a774-67ad12a04b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:04.280028 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79be9119-edc4-41c4-a774-67ad12a04b33 admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:04.283165 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:09:04.291610 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 591/1182] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 13:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 13:09:04.295890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be9119-edc4-41c4-a774-67ad12a04b33 admin admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:04.305997 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79be9119-edc4-41c4-a774-67ad12a04b33 admin admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:04.311433 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b81768-86f1-4b80-9530-8831422f6424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:04.313675 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b81768-86f1-4b80-9530-8831422f6424 admin admin] REQUEST_METHOD: `PUT` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:04.314017 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b81768-86f1-4b80-9530-8831422f6424 admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:04.314480 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b81768-86f1-4b80-9530-8831422f6424 admin admin] PATH_INFO: `/v3/projects/137d654221934c6fb8c20b173991ac10/users/c3519cf127144498bff3f84547743a1b/roles/9bca71f77ac24a898d3445ab3c205809` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:04.332573 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b81768-86f1-4b80-9530-8831422f6424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=137d654221934c6fb8c20b173991ac10, user_id=c3519cf127144498bff3f84547743a1b, role_id=9bca71f77ac24a898d3445ab3c205809)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:04.335310 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b81768-86f1-4b80-9530-8831422f6424 admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:04.372857 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 592/1183] 10.222.0.40 () {60 vars in 1143 bytes} [Thu Jul 14 13:09:04 2022] POST /identity/v3/users => generated 299 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 14 13:09:04.377333 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaae1f0-6d1c-4022-8ec7-fc58ffd58dd4 admin admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:04.388327 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaae1f0-6d1c-4022-8ec7-fc58ffd58dd4 admin admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:04.396518 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc40d4-ff90-4c54-9681-242ee0593517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:04.397388 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc40d4-ff90-4c54-9681-242ee0593517 admin admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:04.397755 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc40d4-ff90-4c54-9681-242ee0593517 admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:04.398108 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdc40d4-ff90-4c54-9681-242ee0593517 admin admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:04.398863 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc40d4-ff90-4c54-9681-242ee0593517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:04.400504 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdc40d4-ff90-4c54-9681-242ee0593517 admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:04.431342 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 593/1184] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 13:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 13:09:04.431342 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc40d4-ff90-4c54-9681-242ee0593517 admin admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:04.431342 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdc40d4-ff90-4c54-9681-242ee0593517 admin admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:04.436059 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655381f-d609-4bdf-a431-657d22aca411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:04.437611 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655381f-d609-4bdf-a431-657d22aca411 admin admin] REQUEST_METHOD: `PUT` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:04.437883 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655381f-d609-4bdf-a431-657d22aca411 admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:04.438218 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d655381f-d609-4bdf-a431-657d22aca411 admin admin] PATH_INFO: `/v3/projects/97500baca18e487e9ecedcbb18ff2fb6/users/d3626f7a075641f9ab4f66654c8aa102/roles/9bca71f77ac24a898d3445ab3c205809` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:04.458899 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655381f-d609-4bdf-a431-657d22aca411 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97500baca18e487e9ecedcbb18ff2fb6, user_id=d3626f7a075641f9ab4f66654c8aa102, role_id=9bca71f77ac24a898d3445ab3c205809)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:04.459794 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d655381f-d609-4bdf-a431-657d22aca411 admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:04.484624 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 592/1185] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 13:09:04 2022] PUT /identity/v3/projects/137d654221934c6fb8c20b173991ac10/users/c3519cf127144498bff3f84547743a1b/roles/9bca71f77ac24a898d3445ab3c205809 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 13:09:04.488695 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b81768-86f1-4b80-9530-8831422f6424 admin admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:04.565220 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b81768-86f1-4b80-9530-8831422f6424 admin admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:04.565488 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 594/1186] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 13:09:04 2022] PUT /identity/v3/projects/97500baca18e487e9ecedcbb18ff2fb6/users/d3626f7a075641f9ab4f66654c8aa102/roles/9bca71f77ac24a898d3445ab3c205809 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 13:09:04.569616 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655381f-d609-4bdf-a431-657d22aca411 admin admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:04.690424 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cb7c1-1dae-4c68-933a-ddd801819631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:04.691281 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cb7c1-1dae-4c68-933a-ddd801819631 admin admin] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:04.691431 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cb7c1-1dae-4c68-933a-ddd801819631 admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:04.691717 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cb7c1-1dae-4c68-933a-ddd801819631 admin admin] PATH_INFO: `/v3/roles` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:04.693272 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cb7c1-1dae-4c68-933a-ddd801819631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:04.698940 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cb7c1-1dae-4c68-933a-ddd801819631 admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:04.719905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d655381f-d609-4bdf-a431-657d22aca411 admin admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:04.726440 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a18adc-f510-4191-85e7-e3bcd991bdcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:04.727119 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a18adc-f510-4191-85e7-e3bcd991bdcf admin admin] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:04.727406 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a18adc-f510-4191-85e7-e3bcd991bdcf admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:04.727673 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 593/1187] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 13:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 14 13:09:04.727988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a18adc-f510-4191-85e7-e3bcd991bdcf admin admin] PATH_INFO: `/v3/roles` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:04.728770 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a18adc-f510-4191-85e7-e3bcd991bdcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:04.730409 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a18adc-f510-4191-85e7-e3bcd991bdcf admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:04.752037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cb7c1-1dae-4c68-933a-ddd801819631 admin admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:04.752037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cb7c1-1dae-4c68-933a-ddd801819631 admin admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:04.756892 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14469441-7cdf-498d-835b-70ca33a36229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:04.757884 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14469441-7cdf-498d-835b-70ca33a36229 admin admin] REQUEST_METHOD: `PUT` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:04.758238 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14469441-7cdf-498d-835b-70ca33a36229 admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:04.758521 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14469441-7cdf-498d-835b-70ca33a36229 admin admin] PATH_INFO: `/v3/projects/137d654221934c6fb8c20b173991ac10/users/c3519cf127144498bff3f84547743a1b/roles/9bca71f77ac24a898d3445ab3c205809` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:04.764916 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14469441-7cdf-498d-835b-70ca33a36229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=137d654221934c6fb8c20b173991ac10, user_id=c3519cf127144498bff3f84547743a1b, role_id=9bca71f77ac24a898d3445ab3c205809)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:04.766048 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 595/1188] 10.222.0.40 () {58 vars in 1121 bytes} [Thu Jul 14 13:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 14 13:09:04.767554 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14469441-7cdf-498d-835b-70ca33a36229 admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:04.768280 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a18adc-f510-4191-85e7-e3bcd991bdcf admin admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:04.794546 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 594/1189] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 13:09:04 2022] PUT /identity/v3/projects/137d654221934c6fb8c20b173991ac10/users/c3519cf127144498bff3f84547743a1b/roles/9bca71f77ac24a898d3445ab3c205809 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 13:09:04.799838 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a18adc-f510-4191-85e7-e3bcd991bdcf admin admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:04.879271 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787ca47-b557-4875-a715-81f15ab6d5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:04.880108 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787ca47-b557-4875-a715-81f15ab6d5f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:04.880424 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787ca47-b557-4875-a715-81f15ab6d5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:04.880995 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2787ca47-b557-4875-a715-81f15ab6d5f6 admin admin] PATH_INFO: `/v3/projects/97500baca18e487e9ecedcbb18ff2fb6/users/d3626f7a075641f9ab4f66654c8aa102/roles/9bca71f77ac24a898d3445ab3c205809` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:04.883649 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787ca47-b557-4875-a715-81f15ab6d5f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97500baca18e487e9ecedcbb18ff2fb6, user_id=d3626f7a075641f9ab4f66654c8aa102, role_id=9bca71f77ac24a898d3445ab3c205809)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:04.886918 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2787ca47-b557-4875-a715-81f15ab6d5f6 admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:04.903224 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 596/1190] 10.222.0.40 () {60 vars in 1482 bytes} [Thu Jul 14 13:09:04 2022] PUT /identity/v3/projects/97500baca18e487e9ecedcbb18ff2fb6/users/d3626f7a075641f9ab4f66654c8aa102/roles/9bca71f77ac24a898d3445ab3c205809 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 13:09:12.349538 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c98a0-ca8e-4b0f-94f6-19d30c34b6d9 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:12.350445 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c98a0-ca8e-4b0f-94f6-19d30c34b6d9 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:12.350781 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c98a0-ca8e-4b0f-94f6-19d30c34b6d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:12.401372 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-070c98a0-ca8e-4b0f-94f6-19d30c34b6d9 None None] MFA Rules not processed for user `d3626f7a075641f9ab4f66654c8aa102`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:09:12.402546 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-070c98a0-ca8e-4b0f-94f6-19d30c34b6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:09:12.511659 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:09:12.580342 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 595/1191] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:09:12 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:09:12.610005 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787ca47-b557-4875-a715-81f15ab6d5f6 admin admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:12.610005 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-2787ca47-b557-4875-a715-81f15ab6d5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:09:12.684244 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2787ca47-b557-4875-a715-81f15ab6d5f6 admin admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:12.687534 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d8f11-f503-4281-99e4-f68f2657584e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8ba3c2afa1e4499bafda337dc4dc2a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:12.688281 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d8f11-f503-4281-99e4-f68f2657584e service glance] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:12.688828 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d8f11-f503-4281-99e4-f68f2657584e service glance] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:12.689308 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491d8f11-f503-4281-99e4-f68f2657584e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:12.694925 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:09:12.770250 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d8f11-f503-4281-99e4-f68f2657584e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:12.772063 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491d8f11-f503-4281-99e4-f68f2657584e service glance] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:12.794473 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 597/1192] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:09:12 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:09:13.056472 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3be69-1256-46ce-8c05-22256a677579 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:13.056816 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3be69-1256-46ce-8c05-22256a677579 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:13.057118 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a3be69-1256-46ce-8c05-22256a677579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:13.089787 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-46a3be69-1256-46ce-8c05-22256a677579 None None] MFA Rules not processed for user `c3519cf127144498bff3f84547743a1b`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:09:13.094575 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-46a3be69-1256-46ce-8c05-22256a677579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:09:13.202613 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 596/1193] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:09:13 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:09:13.225061 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d8f11-f503-4281-99e4-f68f2657584e service glance] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:13.236433 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491d8f11-f503-4281-99e4-f68f2657584e service glance] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:13.244617 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792ed7a-3e65-4775-9de9-a01072d3827c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8ba3c2afa1e4499bafda337dc4dc2a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:13.245477 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792ed7a-3e65-4775-9de9-a01072d3827c service glance] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:13.245931 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792ed7a-3e65-4775-9de9-a01072d3827c service glance] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:13.246244 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792ed7a-3e65-4775-9de9-a01072d3827c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:13.382534 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792ed7a-3e65-4775-9de9-a01072d3827c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:13.384897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792ed7a-3e65-4775-9de9-a01072d3827c service glance] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:13.397583 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 598/1194] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:09:13 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:09:23.033883 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd8cff-fb37-4914-8651-f7bdf36bc367 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:23.034478 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd8cff-fb37-4914-8651-f7bdf36bc367 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:23.034478 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffd8cff-fb37-4914-8651-f7bdf36bc367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:23.052716 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-1ffd8cff-fb37-4914-8651-f7bdf36bc367 None None] MFA Rules not processed for user `ce0eeaa4b4b54c6da48a86ebec8a1153`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:09:23.053958 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-1ffd8cff-fb37-4914-8651-f7bdf36bc367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:09:23.061592 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 597/1195] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:09:23 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:09:23.352954 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900960b-56fc-4d51-85c1-4dea157ba23f None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:23.355300 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900960b-56fc-4d51-85c1-4dea157ba23f None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:23.355300 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d900960b-56fc-4d51-85c1-4dea157ba23f None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:23.355300 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 599/1196] 10.222.0.40 () {54 vars in 961 bytes} [Thu Jul 14 13:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 13:09:23.360520 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb41921-b478-42db-a14b-3125edc907fc None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:23.360929 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb41921-b478-42db-a14b-3125edc907fc None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:23.361290 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb41921-b478-42db-a14b-3125edc907fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:23.379812 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-adb41921-b478-42db-a14b-3125edc907fc None None] MFA Rules not processed for user `1faa19de04744a4084a9c60c4af64f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:09:23.383964 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-adb41921-b478-42db-a14b-3125edc907fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:09:23.392438 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=53 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:09:23.446301 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 598/1197] 10.222.0.40 () {58 vars in 1058 bytes} [Thu Jul 14 13:09:23 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:09:23.451816 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e4f88-183a-4194-aac9-dac70552779f None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:23.452138 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e4f88-183a-4194-aac9-dac70552779f None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:23.452423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2e4f88-183a-4194-aac9-dac70552779f None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:23.453876 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 600/1198] 10.222.0.40 () {54 vars in 912 bytes} [Thu Jul 14 13:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:09:23.463807 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a32afb-43c1-43be-b357-735bc547616e None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:23.464154 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a32afb-43c1-43be-b357-735bc547616e None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:23.464433 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a32afb-43c1-43be-b357-735bc547616e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:23.483450 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-c0a32afb-43c1-43be-b357-735bc547616e None None] MFA Rules not processed for user `1faa19de04744a4084a9c60c4af64f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:09:23.484659 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-c0a32afb-43c1-43be-b357-735bc547616e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:09:23.493087 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 599/1199] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 14 13:09:23 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:09:23.504350 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e4f88-183a-4194-aac9-dac70552779f None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:23.506056 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-ef2e4f88-183a-4194-aac9-dac70552779f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:09:23.519136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2e4f88-183a-4194-aac9-dac70552779f None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:23.522604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bba3aa-369c-40c0-9b23-37c8c57008ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8ba3c2afa1e4499bafda337dc4dc2a9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:23.523236 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bba3aa-369c-40c0-9b23-37c8c57008ee service glance] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:23.523520 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bba3aa-369c-40c0-9b23-37c8c57008ee service glance] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:23.523790 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bba3aa-369c-40c0-9b23-37c8c57008ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:23.533713 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bba3aa-369c-40c0-9b23-37c8c57008ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:23.535096 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bba3aa-369c-40c0-9b23-37c8c57008ee service glance] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:23.545658 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 601/1200] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:09:23 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:09:23.904405 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c7014-2237-4c05-ba35-ea68c6c89ab4 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:23.904736 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c7014-2237-4c05-ba35-ea68c6c89ab4 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:23.905056 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c7014-2237-4c05-ba35-ea68c6c89ab4 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:23.906500 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 600/1201] 10.222.0.40 () {54 vars in 912 bytes} [Thu Jul 14 13:09:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:09:23.912114 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750cb1f-efdc-4c62-ae11-84cf51303443 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:23.912505 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750cb1f-efdc-4c62-ae11-84cf51303443 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:23.912876 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750cb1f-efdc-4c62-ae11-84cf51303443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:23.931882 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-1750cb1f-efdc-4c62-ae11-84cf51303443 None None] MFA Rules not processed for user `513bc0a2d10240a5bc12cb402da41faf`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:09:23.933153 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-1750cb1f-efdc-4c62-ae11-84cf51303443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:09:23.999786 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 602/1202] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 14 13:09:23 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:09:24.011284 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c7014-2237-4c05-ba35-ea68c6c89ab4 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:24.023224 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c7014-2237-4c05-ba35-ea68c6c89ab4 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:24.027068 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04266bee-4f3f-441a-afc2-70fdf2d87178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:24.028288 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04266bee-4f3f-441a-afc2-70fdf2d87178 service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:24.028571 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04266bee-4f3f-441a-afc2-70fdf2d87178 service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:24.028883 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04266bee-4f3f-441a-afc2-70fdf2d87178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:24.036574 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04266bee-4f3f-441a-afc2-70fdf2d87178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:24.038038 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04266bee-4f3f-441a-afc2-70fdf2d87178 service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:24.046934 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 601/1203] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:09:24 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:09:24.609148 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa30d7-4e8c-471e-a571-9b563f1640ff None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:24.609708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa30d7-4e8c-471e-a571-9b563f1640ff None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:24.609905 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fa30d7-4e8c-471e-a571-9b563f1640ff None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:24.611613 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 603/1204] 10.222.0.40 () {54 vars in 961 bytes} [Thu Jul 14 13:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:09:24.619237 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f52505-5f08-4cb9-933d-5892f082c4bd None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:24.619967 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f52505-5f08-4cb9-933d-5892f082c4bd None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:24.620342 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f52505-5f08-4cb9-933d-5892f082c4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:24.637509 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d1cf5-5098-413b-818e-f4a7671f308e None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:24.637802 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d1cf5-5098-413b-818e-f4a7671f308e None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:24.638089 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5d1cf5-5098-413b-818e-f4a7671f308e None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:24.639525 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 604/1205] 10.222.0.40 () {54 vars in 960 bytes} [Thu Jul 14 13:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:09:24.644782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528bb33-2de6-4e28-9b00-bf4eefbdbaa7 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:24.645076 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528bb33-2de6-4e28-9b00-bf4eefbdbaa7 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:24.645410 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5528bb33-2de6-4e28-9b00-bf4eefbdbaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:24.647612 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-b5f52505-5f08-4cb9-933d-5892f082c4bd None None] MFA Rules not processed for user `1faa19de04744a4084a9c60c4af64f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:09:24.650382 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-b5f52505-5f08-4cb9-933d-5892f082c4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:09:24.664037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 602/1206] 10.222.0.40 () {58 vars in 1058 bytes} [Thu Jul 14 13:09:24 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:09:24.666670 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-5528bb33-2de6-4e28-9b00-bf4eefbdbaa7 None None] MFA Rules not processed for user `ee845fa8cb614ce183d4608e63c3e2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:09:24.667897 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-5528bb33-2de6-4e28-9b00-bf4eefbdbaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:09:24.671307 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf95f55-5c5a-41cd-9dcd-2d6a4c3b6921 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:24.671600 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf95f55-5c5a-41cd-9dcd-2d6a4c3b6921 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:24.671882 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf95f55-5c5a-41cd-9dcd-2d6a4c3b6921 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:24.673764 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 603/1207] 10.222.0.40 () {54 vars in 912 bytes} [Thu Jul 14 13:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 13:09:24.678532 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f79f-ba77-4673-90cd-d29bf798a1f6 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:24.678827 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f79f-ba77-4673-90cd-d29bf798a1f6 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:24.679434 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea1f79f-ba77-4673-90cd-d29bf798a1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:24.701010 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-4ea1f79f-ba77-4673-90cd-d29bf798a1f6 None None] MFA Rules not processed for user `1faa19de04744a4084a9c60c4af64f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:09:24.702226 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-4ea1f79f-ba77-4673-90cd-d29bf798a1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:09:24.712198 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 604/1208] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 14 13:09:24 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 13:09:24.723239 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1f79f-ba77-4673-90cd-d29bf798a1f6 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:24.733936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea1f79f-ba77-4673-90cd-d29bf798a1f6 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:24.737784 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb08c06-bc0d-45be-917e-6b7871a5149e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:24.738551 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb08c06-bc0d-45be-917e-6b7871a5149e service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:24.738911 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb08c06-bc0d-45be-917e-6b7871a5149e service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:24.739289 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb08c06-bc0d-45be-917e-6b7871a5149e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:24.750018 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 605/1209] 10.222.0.40 () {58 vars in 1057 bytes} [Thu Jul 14 13:09:24 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 13:09:24.750511 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb08c06-bc0d-45be-917e-6b7871a5149e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:24.752053 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb08c06-bc0d-45be-917e-6b7871a5149e service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:24.758975 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528bb33-2de6-4e28-9b00-bf4eefbdbaa7 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:24.771118 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5528bb33-2de6-4e28-9b00-bf4eefbdbaa7 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:24.774147 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 605/1210] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:09:24 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:09:24.778129 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0bf2a-c29e-4a93-9be8-83f43850d35a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee845fa8cb614ce183d4608e63c3e2d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:24.778823 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0bf2a-c29e-4a93-9be8-83f43850d35a service placement] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:24.779115 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0bf2a-c29e-4a93-9be8-83f43850d35a service placement] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:24.779419 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af0bf2a-c29e-4a93-9be8-83f43850d35a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:24.781258 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-5af0bf2a-c29e-4a93-9be8-83f43850d35a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:09:24.795215 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0bf2a-c29e-4a93-9be8-83f43850d35a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:24.796907 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af0bf2a-c29e-4a93-9be8-83f43850d35a service placement] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:24.807942 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 606/1211] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:09:24 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 14 13:09:34.767826 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=98 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:09:34.803143 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=64 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:09:39.579830 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1b79f-86a3-4eb5-aece-d1a9b9242a44 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:39.581315 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1b79f-86a3-4eb5-aece-d1a9b9242a44 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:39.581315 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad1b79f-86a3-4eb5-aece-d1a9b9242a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:39.598928 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-7ad1b79f-86a3-4eb5-aece-d1a9b9242a44 None None] MFA Rules not processed for user `513bc0a2d10240a5bc12cb402da41faf`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:09:39.600126 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-7ad1b79f-86a3-4eb5-aece-d1a9b9242a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:09:39.607254 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 606/1212] 10.222.0.59 () {58 vars in 1015 bytes} [Thu Jul 14 13:09:39 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:09:39.620169 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0bf2a-c29e-4a93-9be8-83f43850d35a service placement] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:39.629672 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af0bf2a-c29e-4a93-9be8-83f43850d35a service placement] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:39.633423 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8f5215-bd6c-43f0-ae2f-b9e8fdc0c352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:39.634007 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f5215-bd6c-43f0-ae2f-b9e8fdc0c352 service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:39.634349 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f5215-bd6c-43f0-ae2f-b9e8fdc0c352 service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:39.634635 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8f5215-bd6c-43f0-ae2f-b9e8fdc0c352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:39.646492 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f5215-bd6c-43f0-ae2f-b9e8fdc0c352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:39.646492 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8f5215-bd6c-43f0-ae2f-b9e8fdc0c352 service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:39.652595 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 607/1213] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:09:39 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:09:40.747127 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96ac8e-ac1f-4124-a24d-9c61a528ae4f None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:40.747980 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96ac8e-ac1f-4124-a24d-9c61a528ae4f None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:40.748786 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab96ac8e-ac1f-4124-a24d-9c61a528ae4f None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:40.750594 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 607/1214] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 13:09:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:09:40.763474 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4323a-e4fb-48b1-8514-6262d468b86a None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:40.765249 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4323a-e4fb-48b1-8514-6262d468b86a None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:40.765770 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4323a-e4fb-48b1-8514-6262d468b86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:40.794061 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-a8b4323a-e4fb-48b1-8514-6262d468b86a None None] MFA Rules not processed for user `1faa19de04744a4084a9c60c4af64f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:09:40.795281 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-a8b4323a-e4fb-48b1-8514-6262d468b86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:09:40.804615 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 608/1215] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 13:09:40 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:09:40.818604 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96ac8e-ac1f-4124-a24d-9c61a528ae4f None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:40.834077 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab96ac8e-ac1f-4124-a24d-9c61a528ae4f None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:40.840185 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a1f2c7-789b-4717-be93-414193e9d5a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:40.840898 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1f2c7-789b-4717-be93-414193e9d5a1 service nova] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:40.841201 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1f2c7-789b-4717-be93-414193e9d5a1 service nova] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:40.841483 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a1f2c7-789b-4717-be93-414193e9d5a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:40.852248 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1f2c7-789b-4717-be93-414193e9d5a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:40.854336 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a1f2c7-789b-4717-be93-414193e9d5a1 service nova] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:40.882484 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 608/1216] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:09:40 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:09:47.373414 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304364ab-0159-49bb-b387-3c02b8d25233 None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:47.374374 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304364ab-0159-49bb-b387-3c02b8d25233 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:47.374681 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304364ab-0159-49bb-b387-3c02b8d25233 None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:47.376275 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 609/1217] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 13:09:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:09:47.385241 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af1e70-a653-4602-9a4f-2cd4dcdb4dfa None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:47.386611 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af1e70-a653-4602-9a4f-2cd4dcdb4dfa None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:47.386979 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af1e70-a653-4602-9a4f-2cd4dcdb4dfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:47.405510 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-16af1e70-a653-4602-9a4f-2cd4dcdb4dfa None None] MFA Rules not processed for user `1faa19de04744a4084a9c60c4af64f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:09:47.406703 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-16af1e70-a653-4602-9a4f-2cd4dcdb4dfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:09:47.415252 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 609/1218] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 13:09:47 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 14 13:09:47.429357 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304364ab-0159-49bb-b387-3c02b8d25233 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:09:47.445137 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304364ab-0159-49bb-b387-3c02b8d25233 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:09:47.450348 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be18eda-0ab8-41ee-87c3-126895f7c144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:09:47.450992 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be18eda-0ab8-41ee-87c3-126895f7c144 service nova] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:09:47.451278 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be18eda-0ab8-41ee-87c3-126895f7c144 service nova] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:09:47.451558 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be18eda-0ab8-41ee-87c3-126895f7c144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:09:47.460601 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be18eda-0ab8-41ee-87c3-126895f7c144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:09:47.462749 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be18eda-0ab8-41ee-87c3-126895f7c144 service nova] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:09:47.473626 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 610/1219] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:09:47 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:09:57.400442 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=12 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:09:57.468814 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=15 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:10:07.500418 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af1e70-a653-4602-9a4f-2cd4dcdb4dfa None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:10:07.510478 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af1e70-a653-4602-9a4f-2cd4dcdb4dfa None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:10:07.514172 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104d5b5-4b8b-45fa-9ca2-b1f89d510d9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:10:07.514877 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104d5b5-4b8b-45fa-9ca2-b1f89d510d9c service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:10:07.515250 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104d5b5-4b8b-45fa-9ca2-b1f89d510d9c service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:10:07.515601 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2104d5b5-4b8b-45fa-9ca2-b1f89d510d9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:10:07.524583 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104d5b5-4b8b-45fa-9ca2-b1f89d510d9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:10:07.526105 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2104d5b5-4b8b-45fa-9ca2-b1f89d510d9c service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:10:07.535595 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 610/1220] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:10:07 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:10:17.531690 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=6 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:11:34.531599 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3343f-3dcd-4c7f-92c5-7c2722c47084 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:11:34.532107 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3343f-3dcd-4c7f-92c5-7c2722c47084 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:11:34.532200 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a3343f-3dcd-4c7f-92c5-7c2722c47084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:11:34.559415 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-f2a3343f-3dcd-4c7f-92c5-7c2722c47084 None None] MFA Rules not processed for user `05d6241eb3e14a13b4e528c06ab5480e`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:11:34.560594 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-f2a3343f-3dcd-4c7f-92c5-7c2722c47084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:11:34.585132 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 611/1221] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:11:34 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:11:44.583031 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=15 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:12:17.340662 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104d5b5-4b8b-45fa-9ca2-b1f89d510d9c service neutron] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:12:17.406418 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2104d5b5-4b8b-45fa-9ca2-b1f89d510d9c service neutron] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:12:17.411563 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a7da3-d345-4a5e-abc2-d4cf4b05c2fa service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee845fa8cb614ce183d4608e63c3e2d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:12:17.412206 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a7da3-d345-4a5e-abc2-d4cf4b05c2fa service placement] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:12:17.412490 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a7da3-d345-4a5e-abc2-d4cf4b05c2fa service placement] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:12:17.412803 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a7da3-d345-4a5e-abc2-d4cf4b05c2fa service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:12:17.421380 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a7da3-d345-4a5e-abc2-d4cf4b05c2fa service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:12:17.422978 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328a7da3-d345-4a5e-abc2-d4cf4b05c2fa service placement] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:12:17.433454 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 611/1222] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:12:17 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:12:26.839140 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda2dd9-f5e5-4bb1-8f87-80820c4f0f47 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:12:26.839912 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda2dd9-f5e5-4bb1-8f87-80820c4f0f47 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:12:26.840068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eda2dd9-f5e5-4bb1-8f87-80820c4f0f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:12:26.858330 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-1eda2dd9-f5e5-4bb1-8f87-80820c4f0f47 None None] MFA Rules not processed for user `05d6241eb3e14a13b4e528c06ab5480e`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:12:26.859523 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-1eda2dd9-f5e5-4bb1-8f87-80820c4f0f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:12:26.867264 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 612/1223] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:12:26 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:12:27.429228 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=27 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:12:36.853453 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=3 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:12:54.203690 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c5fd6-3f2a-44b3-89a3-f2b4b7035b49 None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:12:54.204188 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c5fd6-3f2a-44b3-89a3-f2b4b7035b49 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:12:54.204282 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406c5fd6-3f2a-44b3-89a3-f2b4b7035b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:12:54.222311 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-406c5fd6-3f2a-44b3-89a3-f2b4b7035b49 None None] MFA Rules not processed for user `05d6241eb3e14a13b4e528c06ab5480e`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:12:54.223529 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-406c5fd6-3f2a-44b3-89a3-f2b4b7035b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:12:54.230487 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 612/1224] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:12:54 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:12:54.498604 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173099f7-4c8e-42d8-b836-9bdbca5dc7f0 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:12:54.499103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173099f7-4c8e-42d8-b836-9bdbca5dc7f0 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:12:54.499192 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173099f7-4c8e-42d8-b836-9bdbca5dc7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:12:54.571098 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-173099f7-4c8e-42d8-b836-9bdbca5dc7f0 None None] MFA Rules not processed for user `513bc0a2d10240a5bc12cb402da41faf`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:12:54.572222 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-173099f7-4c8e-42d8-b836-9bdbca5dc7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:12:54.587708 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 613/1225] 10.222.0.40 () {58 vars in 1009 bytes} [Thu Jul 14 13:12:54 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:12:54.598801 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c5fd6-3f2a-44b3-89a3-f2b4b7035b49 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:12:54.608037 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406c5fd6-3f2a-44b3-89a3-f2b4b7035b49 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:12:54.611704 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64147718-cae1-438f-a2cd-343b5eafcb6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:12:54.612936 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64147718-cae1-438f-a2cd-343b5eafcb6b service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:12:54.613225 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64147718-cae1-438f-a2cd-343b5eafcb6b service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:12:54.613508 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64147718-cae1-438f-a2cd-343b5eafcb6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:12:54.620417 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64147718-cae1-438f-a2cd-343b5eafcb6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:12:54.621880 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64147718-cae1-438f-a2cd-343b5eafcb6b service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:12:54.630220 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 613/1226] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:12:54 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:13:04.584880 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=26 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:13:04.626587 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=9 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:13:59.525670 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4c1cc-7904-4d15-ac20-eab81c69b29c None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:13:59.531363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4c1cc-7904-4d15-ac20-eab81c69b29c None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:13:59.531363 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb4c1cc-7904-4d15-ac20-eab81c69b29c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:13:59.544297 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-7bb4c1cc-7904-4d15-ac20-eab81c69b29c None None] MFA Rules not processed for user `ce0eeaa4b4b54c6da48a86ebec8a1153`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:13:59.546067 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-7bb4c1cc-7904-4d15-ac20-eab81c69b29c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:13:59.552933 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 614/1227] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:13:59 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:14:09.538675 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=3 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:14:12.824423 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64147718-cae1-438f-a2cd-343b5eafcb6b service neutron] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:14:12.847349 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64147718-cae1-438f-a2cd-343b5eafcb6b service neutron] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:14:12.854878 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ae1841-da65-498a-beff-72463ef12d78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:14:12.862518 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae1841-da65-498a-beff-72463ef12d78 service nova] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:14:12.862518 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae1841-da65-498a-beff-72463ef12d78 service nova] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:14:12.862518 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ae1841-da65-498a-beff-72463ef12d78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:14:12.864758 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae1841-da65-498a-beff-72463ef12d78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:14:12.866371 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ae1841-da65-498a-beff-72463ef12d78 service nova] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:14:12.879064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 614/1228] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:14:12 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:14:12.928700 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4c1cc-7904-4d15-ac20-eab81c69b29c None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:14:12.942595 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb4c1cc-7904-4d15-ac20-eab81c69b29c None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:14:12.947871 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe80e5ba-7656-4ad6-a086-afbe6a8f9bbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:14:12.948529 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80e5ba-7656-4ad6-a086-afbe6a8f9bbc service nova] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:14:12.948852 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80e5ba-7656-4ad6-a086-afbe6a8f9bbc service nova] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:14:12.949136 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe80e5ba-7656-4ad6-a086-afbe6a8f9bbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:14:12.957527 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80e5ba-7656-4ad6-a086-afbe6a8f9bbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:14:12.959160 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe80e5ba-7656-4ad6-a086-afbe6a8f9bbc service nova] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:14:12.969328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 615/1229] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:14:12 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:14:15.021142 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b3f85-43ad-4e08-98c5-9830cb3765b9 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:14:15.024914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b3f85-43ad-4e08-98c5-9830cb3765b9 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:14:15.024914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b3f85-43ad-4e08-98c5-9830cb3765b9 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:14:15.024914 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 615/1230] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 13:14:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:14:15.028722 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e4a2b-3a7f-4819-985b-c67e5b6fce1d None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:14:15.029146 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e4a2b-3a7f-4819-985b-c67e5b6fce1d None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:14:15.029284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e4a2b-3a7f-4819-985b-c67e5b6fce1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:14:15.080087 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-3b3e4a2b-3a7f-4819-985b-c67e5b6fce1d None None] MFA Rules not processed for user `1faa19de04744a4084a9c60c4af64f3e`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:14:15.081342 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-3b3e4a2b-3a7f-4819-985b-c67e5b6fce1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:14:15.090485 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 616/1231] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 13:14:15 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:14:15.101633 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b3f85-43ad-4e08-98c5-9830cb3765b9 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:14:15.115064 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b3f85-43ad-4e08-98c5-9830cb3765b9 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:14:15.121744 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d04c4-7e04-40aa-a77f-614f91dc259d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:14:15.122334 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d04c4-7e04-40aa-a77f-614f91dc259d service nova] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:14:15.122616 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d04c4-7e04-40aa-a77f-614f91dc259d service nova] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:14:15.122890 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d04c4-7e04-40aa-a77f-614f91dc259d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:14:15.131505 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d04c4-7e04-40aa-a77f-614f91dc259d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:14:15.133699 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d04c4-7e04-40aa-a77f-614f91dc259d service nova] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:14:15.144079 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 616/1232] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:14:15 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:14:25.077638 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=20 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:14:25.139831 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=16 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:14:25.182371 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e4a2b-3a7f-4819-985b-c67e5b6fce1d None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:14:25.246157 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e4a2b-3a7f-4819-985b-c67e5b6fce1d None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:14:25.249772 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a281c66c-deb0-494a-b3c0-bc3b17bc6beb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'efbe88187dd84518818114165f60a5ef', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:14:25.250442 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281c66c-deb0-494a-b3c0-bc3b17bc6beb service cinder] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:14:25.250727 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281c66c-deb0-494a-b3c0-bc3b17bc6beb service cinder] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:14:25.251005 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a281c66c-deb0-494a-b3c0-bc3b17bc6beb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:14:25.261382 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281c66c-deb0-494a-b3c0-bc3b17bc6beb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:14:25.262847 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a281c66c-deb0-494a-b3c0-bc3b17bc6beb service cinder] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:14:25.273782 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 617/1233] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:14:25 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:14:31.666189 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d04c4-7e04-40aa-a77f-614f91dc259d service nova] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:14:31.676062 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d04c4-7e04-40aa-a77f-614f91dc259d service nova] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:14:31.680149 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a4063-8d54-4124-9a89-17a7ac4b7438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:14:31.680816 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a4063-8d54-4124-9a89-17a7ac4b7438 service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:14:31.681102 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a4063-8d54-4124-9a89-17a7ac4b7438 service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:14:31.681381 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719a4063-8d54-4124-9a89-17a7ac4b7438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:14:31.692065 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a4063-8d54-4124-9a89-17a7ac4b7438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:14:31.694124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719a4063-8d54-4124-9a89-17a7ac4b7438 service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:14:31.704234 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 617/1234] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:14:31 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:14:35.268583 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=30 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:14:35.359621 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30f44f-c8cd-425b-962d-99dddd7fd680 None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:14:35.359919 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30f44f-c8cd-425b-962d-99dddd7fd680 None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:14:35.360208 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff30f44f-c8cd-425b-962d-99dddd7fd680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:14:35.377430 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-ff30f44f-c8cd-425b-962d-99dddd7fd680 None None] MFA Rules not processed for user `05d6241eb3e14a13b4e528c06ab5480e`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:14:35.378688 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-ff30f44f-c8cd-425b-962d-99dddd7fd680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:14:35.385642 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 618/1235] 10.222.0.40 () {58 vars in 957 bytes} [Thu Jul 14 13:14:35 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:14:36.482961 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a4063-8d54-4124-9a89-17a7ac4b7438 service neutron] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:14:36.494797 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719a4063-8d54-4124-9a89-17a7ac4b7438 service neutron] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:14:36.500104 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300735e2-3636-4a6e-ba07-3704e9610e03 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee845fa8cb614ce183d4608e63c3e2d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:14:36.500887 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300735e2-3636-4a6e-ba07-3704e9610e03 service placement] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:14:36.501240 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300735e2-3636-4a6e-ba07-3704e9610e03 service placement] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:14:36.501652 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300735e2-3636-4a6e-ba07-3704e9610e03 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:14:36.510881 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300735e2-3636-4a6e-ba07-3704e9610e03 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:14:36.512499 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300735e2-3636-4a6e-ba07-3704e9610e03 service placement] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:14:36.522815 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 618/1236] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:14:36 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:14:40.576232 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30f44f-c8cd-425b-962d-99dddd7fd680 None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:14:40.588459 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff30f44f-c8cd-425b-962d-99dddd7fd680 None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:14:40.592172 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58984bd6-0cdf-4bae-b29e-f28e6baba50c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:14:40.592937 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58984bd6-0cdf-4bae-b29e-f28e6baba50c service neutron] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:14:40.593220 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58984bd6-0cdf-4bae-b29e-f28e6baba50c service neutron] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:14:40.595340 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58984bd6-0cdf-4bae-b29e-f28e6baba50c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:14:40.602048 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58984bd6-0cdf-4bae-b29e-f28e6baba50c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:14:40.603645 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58984bd6-0cdf-4bae-b29e-f28e6baba50c service neutron] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:14:40.612825 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 619/1237] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:14:40 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:14:46.518305 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=12 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:14:49.744323 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300735e2-3636-4a6e-ba07-3704e9610e03 service placement] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:14:49.753557 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300735e2-3636-4a6e-ba07-3704e9610e03 service placement] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:14:49.757192 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ed248-39a7-4945-88ed-cc390a961807 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:14:49.757836 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed248-39a7-4945-88ed-cc390a961807 service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:14:49.758124 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed248-39a7-4945-88ed-cc390a961807 service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:14:49.758408 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918ed248-39a7-4945-88ed-cc390a961807 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:14:49.767310 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ed248-39a7-4945-88ed-cc390a961807 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:14:49.768809 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918ed248-39a7-4945-88ed-cc390a961807 service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:14:49.778144 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 619/1238] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:14:49 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:14:50.608743 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=9 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:14:59.774058 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=6 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:15:40.087440 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58984bd6-0cdf-4bae-b29e-f28e6baba50c service neutron] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:15:40.110300 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58984bd6-0cdf-4bae-b29e-f28e6baba50c service neutron] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:15:40.119655 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6395cc9c-73c1-4fcb-be42-eac622aa70cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1faa19de04744a4084a9c60c4af64f3e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:15:40.121656 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395cc9c-73c1-4fcb-be42-eac622aa70cc service nova] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:15:40.122140 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395cc9c-73c1-4fcb-be42-eac622aa70cc service nova] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:15:40.123162 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6395cc9c-73c1-4fcb-be42-eac622aa70cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:15:40.148910 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395cc9c-73c1-4fcb-be42-eac622aa70cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:15:40.150950 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6395cc9c-73c1-4fcb-be42-eac622aa70cc service nova] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:15:40.164971 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 620/1239] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:15:40 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:15:50.159445 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=6 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:15:57.528790 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ed248-39a7-4945-88ed-cc390a961807 service neutron] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:15:57.538069 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918ed248-39a7-4945-88ed-cc390a961807 service neutron] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:15:57.541686 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9bd77-24e8-4310-8bb7-428ef7b8566a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:15:57.542317 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9bd77-24e8-4310-8bb7-428ef7b8566a service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:15:57.542602 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9bd77-24e8-4310-8bb7-428ef7b8566a service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:15:57.542881 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9bd77-24e8-4310-8bb7-428ef7b8566a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:15:57.610932 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9bd77-24e8-4310-8bb7-428ef7b8566a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:15:57.612400 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9bd77-24e8-4310-8bb7-428ef7b8566a service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:15:57.632675 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 620/1240] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:15:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:16:01.504934 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a884869-1ec4-42ae-854e-f048333c8f5a None None] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:16:01.505760 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a884869-1ec4-42ae-854e-f048333c8f5a None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:16:01.505760 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a884869-1ec4-42ae-854e-f048333c8f5a None None] PATH_INFO: `/` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:16:01.507016 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 621/1241] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 13:16:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 14 13:16:01.525126 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd070f98-133b-4b91-8c13-1024c5e3f71d None None] REQUEST_METHOD: `POST` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:16:01.525577 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd070f98-133b-4b91-8c13-1024c5e3f71d None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:16:01.525671 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd070f98-133b-4b91-8c13-1024c5e3f71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:16:01.580278 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.auth.core [None req-cd070f98-133b-4b91-8c13-1024c5e3f71d None None] MFA Rules not processed for user `ee845fa8cb614ce183d4608e63c3e2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87244) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:16:01.581523 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-cd070f98-133b-4b91-8c13-1024c5e3f71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:16:01.590350 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 621/1242] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 13:16:01 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:16:01.608309 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a884869-1ec4-42ae-854e-f048333c8f5a None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:16:01.616972 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a884869-1ec4-42ae-854e-f048333c8f5a None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:16:01.622242 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6761d00e-6d0f-4f6c-996b-d13685c5b5b1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee845fa8cb614ce183d4608e63c3e2d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:16:01.622901 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761d00e-6d0f-4f6c-996b-d13685c5b5b1 service placement] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:16:01.623365 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761d00e-6d0f-4f6c-996b-d13685c5b5b1 service placement] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:16:01.623667 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6761d00e-6d0f-4f6c-996b-d13685c5b5b1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:16:01.633629 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761d00e-6d0f-4f6c-996b-d13685c5b5b1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:16:01.635258 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6761d00e-6d0f-4f6c-996b-d13685c5b5b1 service placement] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:16:01.646068 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 622/1243] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:16:01 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:16:05.597456 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39de882-d30a-48a6-8f18-077bc0625082 None None] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:16:05.598041 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39de882-d30a-48a6-8f18-077bc0625082 None None] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:16:05.598131 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39de882-d30a-48a6-8f18-077bc0625082 None None] PATH_INFO: `/` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:16:05.599698 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 622/1244] 10.222.0.40 () {54 vars in 921 bytes} [Thu Jul 14 13:16:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 14 13:16:05.611042 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3ac45-f1e6-4b6c-97a9-e4d08d92e4ba None None] REQUEST_METHOD: `POST` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:16:05.611551 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3ac45-f1e6-4b6c-97a9-e4d08d92e4ba None None] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:16:05.611642 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3ac45-f1e6-4b6c-97a9-e4d08d92e4ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:16:05.631285 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.auth.core [None req-d7a3ac45-f1e6-4b6c-97a9-e4d08d92e4ba None None] MFA Rules not processed for user `ee845fa8cb614ce183d4608e63c3e2d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87245) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 14 13:16:05.632408 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-d7a3ac45-f1e6-4b6c-97a9-e4d08d92e4ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:16:05.641542 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 623/1245] 10.222.0.40 () {58 vars in 1018 bytes} [Thu Jul 14 13:16:05 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 14 13:16:05.665398 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39de882-d30a-48a6-8f18-077bc0625082 None None] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:16:05.671576 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39de882-d30a-48a6-8f18-077bc0625082 None None] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:16:05.676670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99056b-58ff-4fd5-ad59-22ba21e55041 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee845fa8cb614ce183d4608e63c3e2d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:16:05.677317 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99056b-58ff-4fd5-ad59-22ba21e55041 service placement] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:16:05.677613 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99056b-58ff-4fd5-ad59-22ba21e55041 service placement] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:16:05.677884 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd99056b-58ff-4fd5-ad59-22ba21e55041 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:16:05.686467 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99056b-58ff-4fd5-ad59-22ba21e55041 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:16:05.688768 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd99056b-58ff-4fd5-ad59-22ba21e55041 service placement] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:16:05.698685 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 623/1246] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:16:05 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:16:05.772039 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3ac45-f1e6-4b6c-97a9-e4d08d92e4ba None None] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:16:05.786077 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3ac45-f1e6-4b6c-97a9-e4d08d92e4ba None None] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:16:05.790931 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9d6c8-6d66-4f7c-b543-6b60dedf5629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:16:05.791816 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9d6c8-6d66-4f7c-b543-6b60dedf5629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:16:05.792103 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9d6c8-6d66-4f7c-b543-6b60dedf5629 admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:16:05.792381 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce9d6c8-6d66-4f7c-b543-6b60dedf5629 admin admin] PATH_INFO: `/v3/users/ce0eeaa4b4b54c6da48a86ebec8a1153` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:16:05.793664 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9d6c8-6d66-4f7c-b543-6b60dedf5629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce0eeaa4b4b54c6da48a86ebec8a1153)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:16:05.795590 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce9d6c8-6d66-4f7c-b543-6b60dedf5629 admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:16:06.066008 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-2ce9d6c8-6d66-4f7c-b543-6b60dedf5629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce0eeaa4b4b54c6da48a86ebec8a1153'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:06.145742 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-2ce9d6c8-6d66-4f7c-b543-6b60dedf5629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce0eeaa4b4b54c6da48a86ebec8a1153'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:06.153705 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-2ce9d6c8-6d66-4f7c-b543-6b60dedf5629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce0eeaa4b4b54c6da48a86ebec8a1153'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:06.154367 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-2ce9d6c8-6d66-4f7c-b543-6b60dedf5629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce0eeaa4b4b54c6da48a86ebec8a1153'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:06.168543 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-2ce9d6c8-6d66-4f7c-b543-6b60dedf5629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce0eeaa4b4b54c6da48a86ebec8a1153'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:06.175207 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 624/1247] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 13:16:05 2022] DELETE /identity/v3/users/ce0eeaa4b4b54c6da48a86ebec8a1153 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 13:16:06.484519 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99056b-58ff-4fd5-ad59-22ba21e55041 service placement] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:16:06.495544 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd99056b-58ff-4fd5-ad59-22ba21e55041 service placement] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:16:06.551102 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2968412-c191-403e-9554-bb4b853c8998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:16:06.551944 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2968412-c191-403e-9554-bb4b853c8998 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:16:06.552219 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2968412-c191-403e-9554-bb4b853c8998 admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:16:06.552486 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2968412-c191-403e-9554-bb4b853c8998 admin admin] PATH_INFO: `/v3/projects/cbe1bb4b402b49a3993f110cdc46384c` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:16:06.554561 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2968412-c191-403e-9554-bb4b853c8998 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbe1bb4b402b49a3993f110cdc46384c)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:16:06.555672 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2968412-c191-403e-9554-bb4b853c8998 admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:16:06.674212 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:16:06.683513 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-a2968412-c191-403e-9554-bb4b853c8998 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbe1bb4b402b49a3993f110cdc46384c', 'request_id': 'req-a2968412-c191-403e-9554-bb4b853c8998'} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:06.690096 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-a2968412-c191-403e-9554-bb4b853c8998 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbe1bb4b402b49a3993f110cdc46384c', 'request_id': 'req-a2968412-c191-403e-9554-bb4b853c8998'} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:06.785837 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-a2968412-c191-403e-9554-bb4b853c8998 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbe1bb4b402b49a3993f110cdc46384c', 'request_id': 'req-a2968412-c191-403e-9554-bb4b853c8998'} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:06.810066 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-a2968412-c191-403e-9554-bb4b853c8998 admin admin] The token cache is being invalidate because project cbe1bb4b402b49a3993f110cdc46384c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 13:16:06.810356 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-a2968412-c191-403e-9554-bb4b853c8998 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:06.810986 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-a2968412-c191-403e-9554-bb4b853c8998 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:06.813380 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 624/1248] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 13:16:06 2022] DELETE /identity/v3/projects/cbe1bb4b402b49a3993f110cdc46384c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 13:16:06.817377 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9d6c8-6d66-4f7c-b543-6b60dedf5629 admin admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:16:06.818802 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-2ce9d6c8-6d66-4f7c-b543-6b60dedf5629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:16:06.832467 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce9d6c8-6d66-4f7c-b543-6b60dedf5629 admin admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:16:06.887637 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5608967-7dc0-45a9-95da-7811ffdd781d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:16:06.888504 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5608967-7dc0-45a9-95da-7811ffdd781d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:16:06.888828 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5608967-7dc0-45a9-95da-7811ffdd781d admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:16:06.889108 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5608967-7dc0-45a9-95da-7811ffdd781d admin admin] PATH_INFO: `/v3/users/d3626f7a075641f9ab4f66654c8aa102` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:16:06.890815 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5608967-7dc0-45a9-95da-7811ffdd781d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3626f7a075641f9ab4f66654c8aa102)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:16:06.892824 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5608967-7dc0-45a9-95da-7811ffdd781d admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:16:07.135815 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-c5608967-7dc0-45a9-95da-7811ffdd781d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3626f7a075641f9ab4f66654c8aa102'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:07.214045 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-c5608967-7dc0-45a9-95da-7811ffdd781d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3626f7a075641f9ab4f66654c8aa102'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:07.215533 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:16:07.222328 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-c5608967-7dc0-45a9-95da-7811ffdd781d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3626f7a075641f9ab4f66654c8aa102'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:07.225283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-c5608967-7dc0-45a9-95da-7811ffdd781d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3626f7a075641f9ab4f66654c8aa102'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:07.235284 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-c5608967-7dc0-45a9-95da-7811ffdd781d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3626f7a075641f9ab4f66654c8aa102'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:07.241151 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 625/1249] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 13:16:06 2022] DELETE /identity/v3/users/d3626f7a075641f9ab4f66654c8aa102 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 13:16:07.490569 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2968412-c191-403e-9554-bb4b853c8998 admin admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:16:07.492028 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-a2968412-c191-403e-9554-bb4b853c8998 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:16:07.506190 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2968412-c191-403e-9554-bb4b853c8998 admin admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:16:07.564613 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6e714-69c2-47d5-a49d-602fe48fef5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:16:07.565496 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6e714-69c2-47d5-a49d-602fe48fef5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:16:07.565784 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6e714-69c2-47d5-a49d-602fe48fef5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:16:07.566063 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6e714-69c2-47d5-a49d-602fe48fef5e admin admin] PATH_INFO: `/v3/projects/97500baca18e487e9ecedcbb18ff2fb6` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:16:07.567235 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6e714-69c2-47d5-a49d-602fe48fef5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=97500baca18e487e9ecedcbb18ff2fb6)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:16:07.569213 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6e714-69c2-47d5-a49d-602fe48fef5e admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:16:07.719519 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-96b6e714-69c2-47d5-a49d-602fe48fef5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97500baca18e487e9ecedcbb18ff2fb6', 'request_id': 'req-96b6e714-69c2-47d5-a49d-602fe48fef5e'} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:07.728903 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-96b6e714-69c2-47d5-a49d-602fe48fef5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97500baca18e487e9ecedcbb18ff2fb6', 'request_id': 'req-96b6e714-69c2-47d5-a49d-602fe48fef5e'} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:07.802971 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-96b6e714-69c2-47d5-a49d-602fe48fef5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97500baca18e487e9ecedcbb18ff2fb6', 'request_id': 'req-96b6e714-69c2-47d5-a49d-602fe48fef5e'} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:07.813688 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-96b6e714-69c2-47d5-a49d-602fe48fef5e admin admin] The token cache is being invalidate because project 97500baca18e487e9ecedcbb18ff2fb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 13:16:07.821373 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-96b6e714-69c2-47d5-a49d-602fe48fef5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:07.821373 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-96b6e714-69c2-47d5-a49d-602fe48fef5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:16:07.821373 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 625/1250] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 13:16:07 2022] DELETE /identity/v3/projects/97500baca18e487e9ecedcbb18ff2fb6 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 13:16:17.629848 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=11,keystone:DELETE=2 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:16:17.810651 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:DELETE=12,keystone:SELECT=67,keystone:INSERT=2 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:17:20.991283 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5608967-7dc0-45a9-95da-7811ffdd781d admin admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:17:20.992790 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-c5608967-7dc0-45a9-95da-7811ffdd781d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:17:21.074532 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5608967-7dc0-45a9-95da-7811ffdd781d admin admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:17:21.148471 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692194e-df05-4353-af8b-aeeaf46b5ed7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee845fa8cb614ce183d4608e63c3e2d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:17:21.150182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692194e-df05-4353-af8b-aeeaf46b5ed7 service placement] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:17:21.150182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692194e-df05-4353-af8b-aeeaf46b5ed7 service placement] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:17:21.150182 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7692194e-df05-4353-af8b-aeeaf46b5ed7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:17:21.151776 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-7692194e-df05-4353-af8b-aeeaf46b5ed7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:17:21.164265 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692194e-df05-4353-af8b-aeeaf46b5ed7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:17:21.165937 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7692194e-df05-4353-af8b-aeeaf46b5ed7 service placement] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:17:21.176947 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 626/1251] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:17:20 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:17:31.172548 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=58 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:18:29.141202 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6e714-69c2-47d5-a49d-602fe48fef5e admin admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:18:29.142631 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-96b6e714-69c2-47d5-a49d-602fe48fef5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:18:29.200115 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6e714-69c2-47d5-a49d-602fe48fef5e admin admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:18:29.203957 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d76fb-2993-43a1-bae4-91634ac4882d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '513bc0a2d10240a5bc12cb402da41faf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:18:29.204600 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d76fb-2993-43a1-bae4-91634ac4882d service neutron] REQUEST_METHOD: `GET` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:18:29.204919 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d76fb-2993-43a1-bae4-91634ac4882d service neutron] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:18:29.205221 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845d76fb-2993-43a1-bae4-91634ac4882d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:18:29.207055 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-845d76fb-2993-43a1-bae4-91634ac4882d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:18:29.267841 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d76fb-2993-43a1-bae4-91634ac4882d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:18:29.269458 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845d76fb-2993-43a1-bae4-91634ac4882d service neutron] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:18:29.279413 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 626/1252] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:18:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:18:36.746396 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692194e-df05-4353-af8b-aeeaf46b5ed7 service placement] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:18:36.747982 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-7692194e-df05-4353-af8b-aeeaf46b5ed7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:18:36.762022 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7692194e-df05-4353-af8b-aeeaf46b5ed7 service placement] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:18:36.766554 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa38a13-5a23-4914-8281-d79e35f3fae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:18:36.767421 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa38a13-5a23-4914-8281-d79e35f3fae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:18:36.767709 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa38a13-5a23-4914-8281-d79e35f3fae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:18:36.767988 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa38a13-5a23-4914-8281-d79e35f3fae4 admin admin] PATH_INFO: `/v3/users/05d6241eb3e14a13b4e528c06ab5480e` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:18:36.769186 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa38a13-5a23-4914-8281-d79e35f3fae4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05d6241eb3e14a13b4e528c06ab5480e)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:18:36.771698 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa38a13-5a23-4914-8281-d79e35f3fae4 admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:18:36.919275 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-3aa38a13-5a23-4914-8281-d79e35f3fae4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05d6241eb3e14a13b4e528c06ab5480e'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:36.985312 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-3aa38a13-5a23-4914-8281-d79e35f3fae4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05d6241eb3e14a13b4e528c06ab5480e'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:36.993074 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-3aa38a13-5a23-4914-8281-d79e35f3fae4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05d6241eb3e14a13b4e528c06ab5480e'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:36.993647 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-3aa38a13-5a23-4914-8281-d79e35f3fae4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05d6241eb3e14a13b4e528c06ab5480e'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:37.006247 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-3aa38a13-5a23-4914-8281-d79e35f3fae4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05d6241eb3e14a13b4e528c06ab5480e'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:37.013152 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 627/1253] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 13:18:36 2022] DELETE /identity/v3/users/05d6241eb3e14a13b4e528c06ab5480e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 13:18:37.319283 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d76fb-2993-43a1-bae4-91634ac4882d service neutron] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:18:37.334354 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845d76fb-2993-43a1-bae4-91634ac4882d service neutron] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:18:37.391909 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86287d-d292-45c8-97d5-8ef63b61129c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:18:37.392826 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86287d-d292-45c8-97d5-8ef63b61129c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:18:37.393115 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86287d-d292-45c8-97d5-8ef63b61129c admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:18:37.393396 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee86287d-d292-45c8-97d5-8ef63b61129c admin admin] PATH_INFO: `/v3/projects/3b92f91d118b45a18a0dfff141a85546` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:18:37.394872 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86287d-d292-45c8-97d5-8ef63b61129c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b92f91d118b45a18a0dfff141a85546)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:18:37.397057 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee86287d-d292-45c8-97d5-8ef63b61129c admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:18:37.477732 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-ee86287d-d292-45c8-97d5-8ef63b61129c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b92f91d118b45a18a0dfff141a85546', 'request_id': 'req-ee86287d-d292-45c8-97d5-8ef63b61129c'} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:37.479567 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:18:37.484312 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-ee86287d-d292-45c8-97d5-8ef63b61129c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b92f91d118b45a18a0dfff141a85546', 'request_id': 'req-ee86287d-d292-45c8-97d5-8ef63b61129c'} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:37.539783 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-ee86287d-d292-45c8-97d5-8ef63b61129c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b92f91d118b45a18a0dfff141a85546', 'request_id': 'req-ee86287d-d292-45c8-97d5-8ef63b61129c'} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:37.552555 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-ee86287d-d292-45c8-97d5-8ef63b61129c admin admin] The token cache is being invalidate because project 3b92f91d118b45a18a0dfff141a85546 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 13:18:37.552878 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-ee86287d-d292-45c8-97d5-8ef63b61129c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:37.553541 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-ee86287d-d292-45c8-97d5-8ef63b61129c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:37.555094 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 627/1254] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 13:18:37 2022] DELETE /identity/v3/projects/3b92f91d118b45a18a0dfff141a85546 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 13:18:37.559075 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa38a13-5a23-4914-8281-d79e35f3fae4 admin admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:18:37.560451 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-3aa38a13-5a23-4914-8281-d79e35f3fae4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:18:37.573675 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa38a13-5a23-4914-8281-d79e35f3fae4 admin admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:18:37.634522 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede69721-70d0-400c-885c-8f0d3a4f9bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:18:37.635394 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede69721-70d0-400c-885c-8f0d3a4f9bee admin admin] REQUEST_METHOD: `DELETE` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:18:37.635679 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede69721-70d0-400c-885c-8f0d3a4f9bee admin admin] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:18:37.635953 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede69721-70d0-400c-885c-8f0d3a4f9bee admin admin] PATH_INFO: `/v3/users/c3519cf127144498bff3f84547743a1b` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:18:37.637164 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede69721-70d0-400c-885c-8f0d3a4f9bee admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3519cf127144498bff3f84547743a1b)` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:18:37.639101 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede69721-70d0-400c-885c-8f0d3a4f9bee admin admin] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:18:37.811973 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-ede69721-70d0-400c-885c-8f0d3a4f9bee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3519cf127144498bff3f84547743a1b'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:37.882555 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-ede69721-70d0-400c-885c-8f0d3a4f9bee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3519cf127144498bff3f84547743a1b'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:37.889856 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-ede69721-70d0-400c-885c-8f0d3a4f9bee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3519cf127144498bff3f84547743a1b'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:37.890499 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-ede69721-70d0-400c-885c-8f0d3a4f9bee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3519cf127144498bff3f84547743a1b'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:37.898381 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:18:37.903051 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.notifications [None req-ede69721-70d0-400c-885c-8f0d3a4f9bee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3519cf127144498bff3f84547743a1b'} {{(pid=87245) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:37.908904 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 628/1255] 10.222.0.40 () {58 vars in 1223 bytes} [Thu Jul 14 13:18:37 2022] DELETE /identity/v3/users/c3519cf127144498bff3f84547743a1b => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 14 13:18:38.147546 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86287d-d292-45c8-97d5-8ef63b61129c admin admin] Authenticating user token {{(pid=87244) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:18:38.149362 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.fernet_utils [None req-ee86287d-d292-45c8-97d5-8ef63b61129c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87244) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:18:38.164157 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee86287d-d292-45c8-97d5-8ef63b61129c admin admin] Validating token access rules against request {{(pid=87244) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:18:38.223670 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff4e4bc-eaf4-41e9-91d2-42ad097ea78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ab5d7b1a37b74ac9a2830100d8a3e73f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c24ba159095c44f2835516dff526567e', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87244) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:18:38.224551 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4e4bc-eaf4-41e9-91d2-42ad097ea78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:18:38.224893 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4e4bc-eaf4-41e9-91d2-42ad097ea78a admin admin] SCRIPT_NAME: `/identity` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:18:38.225173 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff4e4bc-eaf4-41e9-91d2-42ad097ea78a admin admin] PATH_INFO: `/v3/projects/137d654221934c6fb8c20b173991ac10` {{(pid=87244) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:18:38.226379 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4e4bc-eaf4-41e9-91d2-42ad097ea78a admin admin] RBAC: Authorizing `identity:delete_project(project_id=137d654221934c6fb8c20b173991ac10)` {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:18:38.228366 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff4e4bc-eaf4-41e9-91d2-42ad097ea78a admin admin] RBAC: Authorization granted {{(pid=87244) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:18:38.360119 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-6ff4e4bc-eaf4-41e9-91d2-42ad097ea78a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '137d654221934c6fb8c20b173991ac10', 'request_id': 'req-6ff4e4bc-eaf4-41e9-91d2-42ad097ea78a'} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:38.366413 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-6ff4e4bc-eaf4-41e9-91d2-42ad097ea78a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '137d654221934c6fb8c20b173991ac10', 'request_id': 'req-6ff4e4bc-eaf4-41e9-91d2-42ad097ea78a'} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:38.441750 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-6ff4e4bc-eaf4-41e9-91d2-42ad097ea78a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '137d654221934c6fb8c20b173991ac10', 'request_id': 'req-6ff4e4bc-eaf4-41e9-91d2-42ad097ea78a'} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:38.453040 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-6ff4e4bc-eaf4-41e9-91d2-42ad097ea78a admin admin] The token cache is being invalidate because project 137d654221934c6fb8c20b173991ac10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87244) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 14 13:18:38.457435 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-6ff4e4bc-eaf4-41e9-91d2-42ad097ea78a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:38.457435 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG keystone.notifications [None req-6ff4e4bc-eaf4-41e9-91d2-42ad097ea78a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87244) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 14 13:18:38.457435 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: [pid: 87244|app: 0|req: 628/1256] 10.222.0.40 () {58 vars in 1232 bytes} [Thu Jul 14 13:18:38 2022] DELETE /identity/v3/projects/137d654221934c6fb8c20b173991ac10 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 14 13:18:48.031312 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=3,keystone:DELETE=1 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:18:48.449768 dv-osbrick-849759-4-ceph devstack@keystone.service[87244]: DEBUG dbcounter [-] [87244] Writing DB stats keystone:SELECT=56,keystone:INSERT=2,keystone:DELETE=10 {{(pid=87244) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 13:22:24.471140 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede69721-70d0-400c-885c-8f0d3a4f9bee admin admin] Authenticating user token {{(pid=87245) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 14 13:22:24.472726 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-ede69721-70d0-400c-885c-8f0d3a4f9bee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:22:24.602892 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede69721-70d0-400c-885c-8f0d3a4f9bee admin admin] Validating token access rules against request {{(pid=87245) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 14 13:22:24.661152 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0032bc9d-7f8a-49d2-88a2-f290e6933b7c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ee845fa8cb614ce183d4608e63c3e2d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2a58a74d443e40a782112277c58028b6', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87245) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 14 13:22:24.661822 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032bc9d-7f8a-49d2-88a2-f290e6933b7c service placement] REQUEST_METHOD: `GET` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 14 13:22:24.662112 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032bc9d-7f8a-49d2-88a2-f290e6933b7c service placement] SCRIPT_NAME: `/identity` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 14 13:22:24.662397 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0032bc9d-7f8a-49d2-88a2-f290e6933b7c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87245) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 14 13:22:24.664230 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.fernet_utils [None req-0032bc9d-7f8a-49d2-88a2-f290e6933b7c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87245) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 14 13:22:24.676894 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032bc9d-7f8a-49d2-88a2-f290e6933b7c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 14 13:22:24.678627 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0032bc9d-7f8a-49d2-88a2-f290e6933b7c service placement] RBAC: Authorization granted {{(pid=87245) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 14 13:22:24.689077 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: [pid: 87245|app: 0|req: 629/1257] 10.222.0.40 () {60 vars in 1365 bytes} [Thu Jul 14 13:22:24 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 14 13:22:34.684745 dv-osbrick-849759-4-ceph devstack@keystone.service[87245]: DEBUG dbcounter [-] [87245] Writing DB stats keystone:SELECT=84 {{(pid=87245) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}